Aug 01 11:54:18 user nova-compute[72178]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 01 11:54:21 user nova-compute[72178]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72178) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72178) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72178) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Aug 01 11:54:21 user nova-compute[72178]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.031s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:54:21 user nova-compute[72178]: INFO nova.virt.driver [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 01 11:54:21 user nova-compute[72178]: INFO nova.compute.provider_config [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] Acquiring lock "singleton_lock" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] Acquired lock "singleton_lock" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] Releasing lock "singleton_lock" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] Full set of CONF: {{(pid=72178) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ******************************************************************************** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] Configuration options gathered from: {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ================================================================================ {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] allow_resize_to_same_host      = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] arq_binding_timeout            = 300 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] backdoor_port                  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] backdoor_socket                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] block_device_allocate_retries  = 300 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] block_device_allocate_retries_interval = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cert                           = self.pem {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute_monitors               = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] config_dir                     = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] config_drive_format            = iso9660 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] config_source                  = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] console_host                   = user {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] control_exchange               = nova {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cpu_allocation_ratio           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] daemon                         = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] debug                          = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] default_access_ip_network_name = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] default_availability_zone      = nova {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] default_ephemeral_format       = ext4 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] default_schedule_zone          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] disk_allocation_ratio          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] enable_new_services            = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] enabled_ssl_apis               = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] flat_injected                  = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] force_config_drive             = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] force_raw_images               = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] graceful_shutdown_timeout      = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] heal_instance_info_cache_interval = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] host                           = user {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] instance_build_timeout         = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] instance_delete_interval       = 300 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] instance_name_template         = instance-%08x {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] instance_usage_audit           = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] instance_usage_audit_period    = month {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] internal_service_availability_zone = internal {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] key                            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] live_migration_retry_count     = 30 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] log_config_append              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] log_dir                        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] log_file                       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] log_options                    = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] log_rotate_interval            = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] log_rotate_interval_type       = days {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] log_rotation_type              = none {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] long_rpc_timeout               = 1800 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] max_concurrent_builds          = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] max_concurrent_live_migrations = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] max_concurrent_snapshots       = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] max_local_block_devices        = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] max_logfile_count              = 30 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] max_logfile_size_mb            = 200 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] maximum_instance_delete_attempts = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] metadata_listen                = 0.0.0.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] metadata_listen_port           = 8775 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] metadata_workers               = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] migrate_max_retries            = -1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] mkisofs_cmd                    = genisoimage {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] my_ip                          = 10.0.0.210 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] network_allocate_retries       = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] osapi_compute_listen_port      = 8774 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] osapi_compute_unique_server_name_scope =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] osapi_compute_workers          = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] password_length                = 12 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] periodic_enable                = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] periodic_fuzzy_delay           = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] pointer_model                  = ps2mouse {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] preallocate_images             = none {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] publish_errors                 = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] pybasedir                      = /opt/stack/nova {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ram_allocation_ratio           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] rate_limit_burst               = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] rate_limit_except_level        = CRITICAL {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] rate_limit_interval            = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] reboot_timeout                 = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] reclaim_instance_interval      = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] record                         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] reimage_timeout_per_gb         = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] report_interval                = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] rescue_timeout                 = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] reserved_host_cpus             = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] reserved_host_disk_mb          = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] reserved_host_memory_mb        = 512 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] reserved_huge_pages            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] resize_confirm_window          = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] resize_fs_using_block_device   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] resume_guests_state_on_host_boot = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] rpc_response_timeout           = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] run_external_periodic_tasks    = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] running_deleted_instance_action = reap {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] running_deleted_instance_timeout = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler_instance_sync_interval = 120 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_down_time              = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] servicegroup_driver            = db {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] shelved_offload_time           = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] shelved_poll_interval          = 3600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] shutdown_timeout               = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] source_is_ipv6                 = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ssl_only                       = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] state_path                     = /opt/stack/data/nova {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] sync_power_state_interval      = 600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] sync_power_state_pool_size     = 1000 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] syslog_log_facility            = LOG_USER {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] tempdir                        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] timeout_nbd                    = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] transport_url                  = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] update_resources_interval      = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] use_cow_images                 = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] use_eventlog                   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] use_journal                    = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] use_json                       = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] use_rootwrap_daemon            = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] use_stderr                     = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] use_syslog                     = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vcpu_pin_set                   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plugging_is_fatal          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plugging_timeout           = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] virt_mkfs                      = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] volume_usage_poll_interval     = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] watch_log_file                 = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] web                            = /usr/share/spice-html5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_concurrency.disable_process_locking = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.auth_strategy              = keystone {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.compute_link_prefix        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.dhcp_domain                = novalocal {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.enable_instance_password   = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.glance_link_prefix         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.instance_list_per_project_cells = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.list_records_by_skipping_down_cells = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.local_metadata_per_cell    = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.max_limit                  = 1000 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.metadata_cache_expiration  = 15 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.neutron_default_tenant_id  = default {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.use_forwarded_for          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.use_neutron_default_nets   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.vendordata_dynamic_targets = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.vendordata_jsonfile_path   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.backend_argument         = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.config_prefix            = cache.oslo {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.dead_timeout             = 60.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.debug_cache_backend      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.enable_retry_client      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.enable_socket_keepalive  = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.enabled                  = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.expiration_time          = 600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.hashclient_retry_attempts = 2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_dead_retry      = 300 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_password        =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_sasl_enabled    = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.memcache_username        =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.proxies                  = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.retry_attempts           = 2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.retry_delay              = 0.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.socket_keepalive_count   = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.socket_keepalive_idle    = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.socket_keepalive_interval = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.tls_allowed_ciphers      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.tls_cafile               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.tls_certfile             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.tls_enabled              = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cache.tls_keyfile              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.auth_section            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.auth_type               = password {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.cafile                  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.certfile                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.collect_timing          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.cross_az_attach         = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.debug                   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.endpoint_template       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.http_retries            = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.insecure                = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.keyfile                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.os_region_name          = RegionOne {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.split_loggers           = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cinder.timeout                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.cpu_dedicated_set      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.cpu_shared_set         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.image_type_exclude_list = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.resource_provider_association_refresh = 300 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.shutdown_retry_interval = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] conductor.workers              = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] console.allowed_origins        = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] console.ssl_ciphers            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] console.ssl_minimum_version    = default {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] consoleauth.token_ttl          = 600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.cafile                  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.certfile                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.collect_timing          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.connect_retries         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.connect_retry_delay     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.endpoint_override       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.insecure                = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.keyfile                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.max_version             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.min_version             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.region_name             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.service_name            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.service_type            = accelerator {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.split_loggers           = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.status_code_retries     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.status_code_retry_delay = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.timeout                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] cyborg.version                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.backend               = sqlalchemy {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.connection            = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.connection_debug      = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.connection_parameters =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.connection_recycle_time = 3600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.connection_trace      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.db_inc_retry_interval = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.db_max_retries        = 20 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.db_max_retry_interval = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.db_retry_interval     = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.max_overflow          = 50 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.max_pool_size         = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.max_retries           = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.mysql_enable_ndb      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.mysql_wsrep_sync_wait = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.pool_timeout          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.retry_interval        = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.slave_connection      = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] database.sqlite_synchronous    = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.backend           = sqlalchemy {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.connection        = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.connection_debug  = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.connection_parameters =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.connection_recycle_time = 3600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.connection_trace  = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.db_inc_retry_interval = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.db_max_retries    = 20 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.db_max_retry_interval = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.db_retry_interval = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.max_overflow      = 50 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.max_pool_size     = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.max_retries       = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.mysql_enable_ndb  = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.pool_timeout      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.retry_interval    = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.slave_connection  = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] api_database.sqlite_synchronous = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] devices.enabled_mdev_types     = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ephemeral_storage_encryption.enabled = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.api_servers             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.cafile                  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.certfile                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.collect_timing          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.connect_retries         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.connect_retry_delay     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.debug                   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.default_trusted_certificate_ids = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.enable_certificate_validation = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.enable_rbd_download     = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.endpoint_override       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.insecure                = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.keyfile                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.max_version             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.min_version             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.num_retries             = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.rbd_ceph_conf           =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.rbd_connect_timeout     = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.rbd_pool                =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.rbd_user                =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.region_name             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.service_name            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.service_type            = image {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.split_loggers           = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.status_code_retries     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.status_code_retry_delay = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.timeout                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.verify_glance_signatures = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] glance.version                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] guestfs.debug                  = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.config_drive_cdrom      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.config_drive_inject_password = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.enable_remotefx         = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.instances_path_share    =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.limit_cpu_features      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.use_multipath_io        = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.vswitch_name            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] mks.enabled                    = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] image_cache.manager_interval   = 2400 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] image_cache.precache_concurrency = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] image_cache.remove_unused_base_images = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] image_cache.subdirectory_name  = _base {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.api_max_retries         = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.api_retry_interval      = 2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.auth_section            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.auth_type               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.cafile                  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.certfile                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.collect_timing          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.connect_retries         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.connect_retry_delay     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.endpoint_override       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.insecure                = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.keyfile                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.max_version             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.min_version             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.partition_key           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.peer_list               = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.region_name             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.serial_console_state_timeout = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.service_name            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.service_type            = baremetal {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.split_loggers           = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.status_code_retries     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.status_code_retry_delay = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.timeout                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ironic.version                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] key_manager.fixed_key          = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.barbican_api_version  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.barbican_endpoint     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.barbican_endpoint_type = public {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.barbican_region_name  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.cafile                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.certfile              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.collect_timing        = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.insecure              = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.keyfile               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.number_of_retries     = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.retry_delay           = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.send_service_user_token = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.split_loggers         = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.timeout               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.verify_ssl            = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican.verify_ssl_path       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.auth_section = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.auth_type = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.cafile   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.certfile = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.collect_timing = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.insecure = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.keyfile  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.split_loggers = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] barbican_service_user.timeout  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.approle_role_id          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.approle_secret_id        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.cafile                   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.certfile                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.collect_timing           = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.insecure                 = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.keyfile                  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.kv_mountpoint            = secret {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.kv_version               = 2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.namespace                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.root_token_id            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.split_loggers            = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.ssl_ca_crt_file          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.timeout                  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.use_ssl                  = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.cafile                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.certfile              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.collect_timing        = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.connect_retries       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.connect_retry_delay   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.endpoint_override     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.insecure              = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.keyfile               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.max_version           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.min_version           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.region_name           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.service_name          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.service_type          = identity {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.split_loggers         = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.status_code_retries   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.status_code_retry_delay = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.timeout               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] keystone.version               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.connection_uri         =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.cpu_mode               = custom {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: WARNING oslo_config.cfg [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.cpu_power_governor_high = performance {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.cpu_power_management   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.device_detach_attempts = 8 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.device_detach_timeout  = 20 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.disk_cachemodes        = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.disk_prefix            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.enabled_perf_events    = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.file_backed_memory     = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.gid_maps               = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.hw_disk_discard        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.hw_machine_type        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.images_rbd_pool        = rbd {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.images_type            = default {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.images_volume_group    = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.inject_key             = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.inject_partition       = -2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.inject_password        = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.iscsi_iface            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.iser_use_multipath     = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_downtime = 500 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_inbound_addr = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_scheme  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_timeout_action = abort {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_tunnelled = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: WARNING oslo_config.cfg [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 01 11:54:21 user nova-compute[72178]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 01 11:54:21 user nova-compute[72178]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 01 11:54:21 user nova-compute[72178]: and ``live_migration_inbound_addr`` respectively.
Aug 01 11:54:21 user nova-compute[72178]: ).  Its value may be silently ignored in the future.
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.live_migration_with_native_tls = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.max_queues             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.nfs_mount_options      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.num_pcie_ports         = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.pmem_namespaces        = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.quobyte_client_cfg     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rbd_secret_uuid        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rbd_user               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rescue_image_id        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rescue_kernel_id       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.rx_queue_size          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.smbfs_mount_options    =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.snapshot_compression   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.snapshot_image_format  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.sparse_logical_volumes = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.swtpm_enabled          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.swtpm_group            = tss {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.swtpm_user             = tss {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.sysinfo_serial         = unique {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.tb_cache_size          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.tx_queue_size          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.uid_maps               = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.use_virtio_for_bridges = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.virt_type              = kvm {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.volume_clear           = zero {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.volume_clear_size      = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.volume_use_multipath   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.vzstorage_cache_path   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.auth_section           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.auth_type              = password {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.cafile                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.certfile               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.collect_timing         = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.connect_retries        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.connect_retry_delay    = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.default_floating_pool  = public {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.endpoint_override      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.extension_sync_interval = 600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.http_retries           = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.insecure               = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.keyfile                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.max_version            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.min_version            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.ovs_bridge             = br-int {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.physnets               = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.region_name            = RegionOne {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.service_metadata_proxy = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.service_name           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.service_type           = network {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.split_loggers          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.status_code_retries    = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.status_code_retry_delay = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.timeout                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] neutron.version                = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] notifications.bdms_in_notifications = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] notifications.default_level    = INFO {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] notifications.notification_format = unversioned {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] notifications.notify_on_state_change = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] pci.alias                      = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] pci.device_spec                = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] pci.report_in_placement        = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.auth_section         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.auth_type            = password {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.cafile               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.certfile             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.collect_timing       = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.connect_retries      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.connect_retry_delay  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.default_domain_id    = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.default_domain_name  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.domain_id            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.domain_name          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.endpoint_override    = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.insecure             = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.keyfile              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.max_version          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.min_version          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.password             = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.project_domain_id    = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.project_domain_name  = Default {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.project_id           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.project_name         = service {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.region_name          = RegionOne {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.service_name         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.service_type         = placement {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.split_loggers        = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.status_code_retries  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.status_code_retry_delay = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.system_scope         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.timeout              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.trust_id             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.user_domain_id       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.user_domain_name     = Default {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.user_id              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.username             = placement {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] placement.version              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.cores                    = 20 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.count_usage_from_placement = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.injected_file_content_bytes = 10240 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.injected_file_path_length = 255 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.injected_files           = 5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.instances                = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.key_pairs                = 100 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.metadata_items           = 128 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.ram                      = 51200 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.recheck_quota            = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.server_group_members     = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] quota.server_groups            = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] rdp.enabled                    = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.image_metadata_prefilter = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.max_attempts         = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.max_placement_results = 1000 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] scheduler.workers              = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.host_subset_size = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.isolated_hosts = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.isolated_images = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.pci_in_placement = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.track_instance_changes = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] metrics.required               = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] metrics.weight_multiplier      = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] metrics.weight_setting         = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] serial_console.enabled         = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] serial_console.port_range      = 10000:20000 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] serial_console.serialproxy_port = 6083 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.auth_section      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.auth_type         = password {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.cafile            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.certfile          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.collect_timing    = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.insecure          = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.keyfile           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.send_service_user_token = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.split_loggers     = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] service_user.timeout           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.agent_enabled            = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.enabled                  = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.html5proxy_port          = 6082 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.image_compression        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.jpeg_compression         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.playback_compression     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.server_listen            = 127.0.0.1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.streaming_mode           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] spice.zlib_compression         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] upgrade_levels.baseapi         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] upgrade_levels.cert            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] upgrade_levels.compute         = auto {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] upgrade_levels.conductor       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] upgrade_levels.scheduler       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.cafile = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.certfile = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.insecure = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vendordata_dynamic_auth.timeout = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.api_retry_count         = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.ca_file                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.cache_prefix            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.cluster_name            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.connection_pool_size    = 10 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.console_delay_seconds   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.datastore_regex         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.host_ip                 = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.host_password           = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.host_port               = 443 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.host_username           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.insecure                = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.integration_bridge      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.maximum_objects         = 100 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.pbm_default_policy      = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.pbm_enabled             = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.pbm_wsdl_location       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.serial_port_proxy_uri   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.serial_port_service_uri = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.task_poll_interval      = 0.5 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.use_linked_clone        = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.vnc_keymap              = en-us {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.vnc_port                = 5900 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vmware.vnc_port_total          = 10000 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.auth_schemes               = ['none'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.enabled                    = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.novncproxy_port            = 6080 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.vencrypt_ca_certs          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.vencrypt_client_cert       = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vnc.vencrypt_client_key        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.disable_rootwrap   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.enable_numa_live_migration = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.libvirt_disable_apic = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.client_socket_timeout     = 900 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.default_pool_size         = 1000 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.keep_alive                = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.max_header_line           = 16384 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.ssl_ca_file               = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.ssl_cert_file             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.ssl_key_file              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.tcp_keepidle              = 600 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] zvm.ca_file                    = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] zvm.cloud_connector_url        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] zvm.reachable_timeout          = 300 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.enforce_new_defaults = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.enforce_scope      = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.policy_default_rule = default {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.connection_string     = messaging:// {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.enabled               = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.es_doc_type           = notification {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.es_scroll_size        = 10000 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.es_scroll_time        = 2m {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.filter_error_trace    = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.hmac_keys             = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.sentinel_service_name = mymaster {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.socket_timeout        = 0.1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.trace_requests        = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler.trace_sqlalchemy      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler_jaeger.process_tags   = {} {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler_jaeger.service_name_prefix = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] profiler_otlp.service_name_prefix = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] remote_debug.host              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] remote_debug.port              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_notifications.retry = -1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.auth_section        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.auth_type           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.cafile              = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.certfile            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.collect_timing      = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.connect_retries     = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.connect_retry_delay = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.endpoint_id         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.endpoint_override   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.insecure            = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.keyfile             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.max_version         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.min_version         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.region_name         = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.service_name        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.service_type        = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.split_loggers       = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.status_code_retries = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.status_code_retry_delay = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.timeout             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.valid_interfaces    = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_limit.version             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_reports.file_event_handler = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] oslo_reports.log_dir           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_ovs_privileged.group  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] vif_plug_ovs_privileged.user   = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_ovs.isolate_vif         = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] os_brick.lock_path             = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] privsep_osbrick.capabilities   = [21] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] privsep_osbrick.group          = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] privsep_osbrick.helper_command = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] privsep_osbrick.user           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] nova_sys_admin.group           = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] nova_sys_admin.helper_command  = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] nova_sys_admin.user            = None {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG oslo_service.service [None req-11d8b5a1-ddbb-4a6e-b303-19e43c61e113 None None] ******************************************************************************** {{(pid=72178) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Aug 01 11:54:21 user nova-compute[72178]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 01 11:54:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Starting native event thread {{(pid=72178) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Starting green dispatch thread {{(pid=72178) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Starting connection event dispatch thread {{(pid=72178) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Connecting to libvirt: qemu:///system {{(pid=72178) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd9000f0a00> {{(pid=72178) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 01 11:54:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd9000f0a00> {{(pid=72178) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 01 11:54:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Connection event '1' reason 'None'
Aug 01 11:54:22 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 11:54:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.mount [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Initialising _HostMountState generation 0 {{(pid=72178) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 01 11:54:29 user nova-compute[72178]: INFO nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host capabilities <capabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <host>
Aug 01 11:54:29 user nova-compute[72178]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 01 11:54:29 user nova-compute[72178]:     <cpu>
Aug 01 11:54:29 user nova-compute[72178]:       <arch>x86_64</arch>
Aug 01 11:54:29 user nova-compute[72178]:       <model>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <microcode version='1070'/>
Aug 01 11:54:29 user nova-compute[72178]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 01 11:54:29 user nova-compute[72178]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='osxsave'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='invtsc'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='rsba'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature name='skip-l1dfl-vmentry'/>
Aug 01 11:54:29 user nova-compute[72178]:       <pages unit='KiB' size='4'/>
Aug 01 11:54:29 user nova-compute[72178]:       <pages unit='KiB' size='2048'/>
Aug 01 11:54:29 user nova-compute[72178]:     </cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <power_management>
Aug 01 11:54:29 user nova-compute[72178]:       <suspend_mem/>
Aug 01 11:54:29 user nova-compute[72178]:       <suspend_disk/>
Aug 01 11:54:29 user nova-compute[72178]:       <suspend_hybrid/>
Aug 01 11:54:29 user nova-compute[72178]:     </power_management>
Aug 01 11:54:29 user nova-compute[72178]:     <iommu support='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <migration_features>
Aug 01 11:54:29 user nova-compute[72178]:       <live/>
Aug 01 11:54:29 user nova-compute[72178]:       <uri_transports>
Aug 01 11:54:29 user nova-compute[72178]:         <uri_transport>tcp</uri_transport>
Aug 01 11:54:29 user nova-compute[72178]:         <uri_transport>rdma</uri_transport>
Aug 01 11:54:29 user nova-compute[72178]:       </uri_transports>
Aug 01 11:54:29 user nova-compute[72178]:     </migration_features>
Aug 01 11:54:29 user nova-compute[72178]:     <topology>
Aug 01 11:54:29 user nova-compute[72178]:       <cells num='2'>
Aug 01 11:54:29 user nova-compute[72178]:         <cell id='0'>
Aug 01 11:54:29 user nova-compute[72178]:           <memory unit='KiB'>8189224</memory>
Aug 01 11:54:29 user nova-compute[72178]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 01 11:54:29 user nova-compute[72178]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 11:54:29 user nova-compute[72178]:           <distances>
Aug 01 11:54:29 user nova-compute[72178]:             <sibling id='0' value='10'/>
Aug 01 11:54:29 user nova-compute[72178]:             <sibling id='1' value='20'/>
Aug 01 11:54:29 user nova-compute[72178]:           </distances>
Aug 01 11:54:29 user nova-compute[72178]:           <cpus num='6'>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 01 11:54:29 user nova-compute[72178]:           </cpus>
Aug 01 11:54:29 user nova-compute[72178]:         </cell>
Aug 01 11:54:29 user nova-compute[72178]:         <cell id='1'>
Aug 01 11:54:29 user nova-compute[72178]:           <memory unit='KiB'>8206460</memory>
Aug 01 11:54:29 user nova-compute[72178]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 01 11:54:29 user nova-compute[72178]:           <pages unit='KiB' size='2048'>0</pages>
Aug 01 11:54:29 user nova-compute[72178]:           <distances>
Aug 01 11:54:29 user nova-compute[72178]:             <sibling id='0' value='20'/>
Aug 01 11:54:29 user nova-compute[72178]:             <sibling id='1' value='10'/>
Aug 01 11:54:29 user nova-compute[72178]:           </distances>
Aug 01 11:54:29 user nova-compute[72178]:           <cpus num='6'>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 01 11:54:29 user nova-compute[72178]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 01 11:54:29 user nova-compute[72178]:           </cpus>
Aug 01 11:54:29 user nova-compute[72178]:         </cell>
Aug 01 11:54:29 user nova-compute[72178]:       </cells>
Aug 01 11:54:29 user nova-compute[72178]:     </topology>
Aug 01 11:54:29 user nova-compute[72178]:     <cache>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 01 11:54:29 user nova-compute[72178]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 01 11:54:29 user nova-compute[72178]:     </cache>
Aug 01 11:54:29 user nova-compute[72178]:     <secmodel>
Aug 01 11:54:29 user nova-compute[72178]:       <model>apparmor</model>
Aug 01 11:54:29 user nova-compute[72178]:       <doi>0</doi>
Aug 01 11:54:29 user nova-compute[72178]:     </secmodel>
Aug 01 11:54:29 user nova-compute[72178]:     <secmodel>
Aug 01 11:54:29 user nova-compute[72178]:       <model>dac</model>
Aug 01 11:54:29 user nova-compute[72178]:       <doi>0</doi>
Aug 01 11:54:29 user nova-compute[72178]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 01 11:54:29 user nova-compute[72178]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 01 11:54:29 user nova-compute[72178]:     </secmodel>
Aug 01 11:54:29 user nova-compute[72178]:   </host>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='alpha'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>clipper</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='armv6l'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>spitz</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>nuri</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>kzm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sx1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>z2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>tosa</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>n810</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>n800</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>terrier</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>midway</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>microbit</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>verdex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>highbank</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>akita</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>connex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>collie</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='armv7l'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>spitz</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>nuri</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>kzm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sx1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>z2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>tosa</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>n810</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>n800</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>terrier</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>midway</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>microbit</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>verdex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>highbank</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>akita</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>connex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>collie</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='aarch64'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>integratorcp</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>borzoi</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>spitz</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>nuri</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>musca-b1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>versatileab</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>kzm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>musca-a</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>smdkc210</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sx1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>z2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>tosa</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>sabrelite</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>realview-eb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>n810</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>n800</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>versatilepb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>terrier</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mainstone</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>midway</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>musicpal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>microbit</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>cubieboard</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>verdex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>netduino2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>raspi3b</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>raspi2b</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>cheetah</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>highbank</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>akita</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>connex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>collie</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>raspi0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <acpi default='on' toggle='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='cris'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='i686'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>isapc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>microvm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='kvm'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <pae/>
Aug 01 11:54:29 user nova-compute[72178]:       <nonpae/>
Aug 01 11:54:29 user nova-compute[72178]:       <acpi default='on' toggle='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:       <apic default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='m68k'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>an5206</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>q800</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>next-cube</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='microblaze'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='microblazeel'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='mips'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='16'>malta</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='mipsel'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='16'>malta</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='mips64'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='16'>malta</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>pica61</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>magnum</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='mips64el'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='16'>malta</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mipssim</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>pica61</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>magnum</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='16'>boston</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='ppc'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mac99</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>40p</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>taihu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='ppc64'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>taihu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>40p</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mac99</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='ppc64le'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2048'>powernv9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>taihu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2048'>powernv10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>ppce500</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>40p</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>pegasos2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>bamboo</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>g3beige</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>mac99</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sam460ex</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>ref405ep</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2048'>powernv8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='riscv32'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='8'>spike</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>opentitan</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='8'>virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='riscv64'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='8'>spike</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='5'>sifive_u</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>shakti_c</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sifive_e</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='8'>virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='s390x'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='sh4'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>shix</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>r2d</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='sh4eb'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>shix</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>r2d</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='sparc'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>SS-5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>SS-20</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>LX</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>SS-4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>SS-10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>Voyager</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='sparc64'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sun4u</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>niagara</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>sun4v</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='x86_64'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>64</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>x-remote</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='1'>isapc</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>microvm</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='kvm'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <acpi default='on' toggle='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:       <apic default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='xtensa'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>sim</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>kc705</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>ml605</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>lx200</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>lx60</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]:   <guest>
Aug 01 11:54:29 user nova-compute[72178]:     <os_type>hvm</os_type>
Aug 01 11:54:29 user nova-compute[72178]:     <arch name='xtensaeb'>
Aug 01 11:54:29 user nova-compute[72178]:       <wordsize>32</wordsize>
Aug 01 11:54:29 user nova-compute[72178]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='4'>sim</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>kc705</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>ml605</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>virt</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>lx200</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>lx60</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 01 11:54:29 user nova-compute[72178]:       <domain type='qemu'/>
Aug 01 11:54:29 user nova-compute[72178]:     </arch>
Aug 01 11:54:29 user nova-compute[72178]:     <features>
Aug 01 11:54:29 user nova-compute[72178]:       <cpuselection/>
Aug 01 11:54:29 user nova-compute[72178]:       <deviceboot/>
Aug 01 11:54:29 user nova-compute[72178]:       <disksnapshot default='on' toggle='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     </features>
Aug 01 11:54:29 user nova-compute[72178]:   </guest>
Aug 01 11:54:29 user nova-compute[72178]: </capabilities>
Aug 01 11:54:29 user nova-compute[72178]: 
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 01 11:54:29 user nova-compute[72178]: <domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 11:54:29 user nova-compute[72178]:   <domain>kvm</domain>
Aug 01 11:54:29 user nova-compute[72178]:   <machine>pc-q35-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:   <arch>i686</arch>
Aug 01 11:54:29 user nova-compute[72178]:   <vcpu max='288'/>
Aug 01 11:54:29 user nova-compute[72178]:   <iothreads supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:   <os supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='firmware'/>
Aug 01 11:54:29 user nova-compute[72178]:     <loader supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>rom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pflash</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='readonly'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='secure'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </loader>
Aug 01 11:54:29 user nova-compute[72178]:   </os>
Aug 01 11:54:29 user nova-compute[72178]:   <cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-passthrough' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='hostPassthroughMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='maximum' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='maximumMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-model' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='umip'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibpb'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibrs'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='erms'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='lm'/>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='custom' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>qemu64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>qemu32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>phenom</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>n270</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>kvm64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>coreduo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>core2duo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>athlon</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Westmere</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Snowridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Penryn</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G5</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G4</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G1</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Rome</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Milan</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Dhyana</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cooperlake</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Conroe</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>486</model>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:   </cpu>
Aug 01 11:54:29 user nova-compute[72178]:   <memoryBacking supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='sourceType'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>file</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>anonymous</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>memfd</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:   </memoryBacking>
Aug 01 11:54:29 user nova-compute[72178]:   <devices>
Aug 01 11:54:29 user nova-compute[72178]:     <disk supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='diskDevice'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>disk</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cdrom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>floppy</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>lun</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='bus'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>fdc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sata</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </disk>
Aug 01 11:54:29 user nova-compute[72178]:     <graphics supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sdl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vnc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>spice</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egl-headless</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </graphics>
Aug 01 11:54:29 user nova-compute[72178]:     <video supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='modelType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cirrus</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vmvga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>qxl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>none</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>bochs</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ramfb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </video>
Aug 01 11:54:29 user nova-compute[72178]:     <hostdev supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='mode'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>subsystem</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='startupPolicy'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>default</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>mandatory</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>requisite</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>optional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='subsysType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pci</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='capsType'/>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='pciBackend'/>
Aug 01 11:54:29 user nova-compute[72178]:     </hostdev>
Aug 01 11:54:29 user nova-compute[72178]:     <rng supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>random</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egd</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>builtin</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </rng>
Aug 01 11:54:29 user nova-compute[72178]:     <filesystem supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='driverType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>path</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>handle</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtiofs</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </filesystem>
Aug 01 11:54:29 user nova-compute[72178]:     <tpm supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-tis</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-crb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>passthrough</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>emulator</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </tpm>
Aug 01 11:54:29 user nova-compute[72178]:   </devices>
Aug 01 11:54:29 user nova-compute[72178]:   <features>
Aug 01 11:54:29 user nova-compute[72178]:     <gic supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <vmcoreinfo supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <genid supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backingStoreInput supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backup supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <sev supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:   </features>
Aug 01 11:54:29 user nova-compute[72178]: </domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 01 11:54:29 user nova-compute[72178]: <domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 11:54:29 user nova-compute[72178]:   <domain>kvm</domain>
Aug 01 11:54:29 user nova-compute[72178]:   <machine>pc-i440fx-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:   <arch>i686</arch>
Aug 01 11:54:29 user nova-compute[72178]:   <vcpu max='255'/>
Aug 01 11:54:29 user nova-compute[72178]:   <iothreads supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:   <os supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='firmware'/>
Aug 01 11:54:29 user nova-compute[72178]:     <loader supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>rom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pflash</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='readonly'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='secure'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </loader>
Aug 01 11:54:29 user nova-compute[72178]:   </os>
Aug 01 11:54:29 user nova-compute[72178]:   <cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-passthrough' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='hostPassthroughMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='maximum' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='maximumMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-model' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='umip'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibpb'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibrs'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='erms'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='lm'/>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='custom' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>qemu64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>qemu32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>phenom</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>n270</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>kvm64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>coreduo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>core2duo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>athlon</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Westmere</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Snowridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Penryn</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G5</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G4</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G1</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Rome</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Milan</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Dhyana</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cooperlake</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Conroe</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>486</model>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:   </cpu>
Aug 01 11:54:29 user nova-compute[72178]:   <memoryBacking supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='sourceType'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>file</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>anonymous</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>memfd</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:   </memoryBacking>
Aug 01 11:54:29 user nova-compute[72178]:   <devices>
Aug 01 11:54:29 user nova-compute[72178]:     <disk supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='diskDevice'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>disk</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cdrom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>floppy</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>lun</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='bus'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ide</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>fdc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sata</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </disk>
Aug 01 11:54:29 user nova-compute[72178]:     <graphics supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sdl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vnc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>spice</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egl-headless</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </graphics>
Aug 01 11:54:29 user nova-compute[72178]:     <video supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='modelType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cirrus</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vmvga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>qxl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>none</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>bochs</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ramfb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </video>
Aug 01 11:54:29 user nova-compute[72178]:     <hostdev supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='mode'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>subsystem</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='startupPolicy'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>default</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>mandatory</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>requisite</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>optional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='subsysType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pci</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='capsType'/>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='pciBackend'/>
Aug 01 11:54:29 user nova-compute[72178]:     </hostdev>
Aug 01 11:54:29 user nova-compute[72178]:     <rng supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>random</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egd</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>builtin</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </rng>
Aug 01 11:54:29 user nova-compute[72178]:     <filesystem supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='driverType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>path</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>handle</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtiofs</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </filesystem>
Aug 01 11:54:29 user nova-compute[72178]:     <tpm supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-tis</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-crb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>passthrough</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>emulator</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </tpm>
Aug 01 11:54:29 user nova-compute[72178]:   </devices>
Aug 01 11:54:29 user nova-compute[72178]:   <features>
Aug 01 11:54:29 user nova-compute[72178]:     <gic supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <vmcoreinfo supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <genid supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backingStoreInput supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backup supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <sev supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:   </features>
Aug 01 11:54:29 user nova-compute[72178]: </domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 01 11:54:29 user nova-compute[72178]: <domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 11:54:29 user nova-compute[72178]:   <domain>kvm</domain>
Aug 01 11:54:29 user nova-compute[72178]:   <machine>pc-q35-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:   <arch>i686</arch>
Aug 01 11:54:29 user nova-compute[72178]:   <vcpu max='288'/>
Aug 01 11:54:29 user nova-compute[72178]:   <iothreads supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:   <os supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='firmware'/>
Aug 01 11:54:29 user nova-compute[72178]:     <loader supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>rom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pflash</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='readonly'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='secure'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </loader>
Aug 01 11:54:29 user nova-compute[72178]:   </os>
Aug 01 11:54:29 user nova-compute[72178]:   <cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-passthrough' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='hostPassthroughMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='maximum' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='maximumMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-model' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='umip'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibpb'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibrs'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='erms'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='lm'/>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='custom' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>qemu64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>qemu32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>phenom</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>n270</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>kvm64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>coreduo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>core2duo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>athlon</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Westmere</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Snowridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Penryn</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G5</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G4</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G1</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Rome</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Milan</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Dhyana</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cooperlake</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Conroe</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>486</model>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:   </cpu>
Aug 01 11:54:29 user nova-compute[72178]:   <memoryBacking supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='sourceType'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>file</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>anonymous</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>memfd</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:   </memoryBacking>
Aug 01 11:54:29 user nova-compute[72178]:   <devices>
Aug 01 11:54:29 user nova-compute[72178]:     <disk supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='diskDevice'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>disk</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cdrom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>floppy</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>lun</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='bus'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>fdc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sata</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </disk>
Aug 01 11:54:29 user nova-compute[72178]:     <graphics supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sdl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vnc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>spice</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egl-headless</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </graphics>
Aug 01 11:54:29 user nova-compute[72178]:     <video supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='modelType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cirrus</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vmvga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>qxl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>none</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>bochs</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ramfb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </video>
Aug 01 11:54:29 user nova-compute[72178]:     <hostdev supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='mode'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>subsystem</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='startupPolicy'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>default</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>mandatory</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>requisite</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>optional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='subsysType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pci</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='capsType'/>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='pciBackend'/>
Aug 01 11:54:29 user nova-compute[72178]:     </hostdev>
Aug 01 11:54:29 user nova-compute[72178]:     <rng supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>random</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egd</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>builtin</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </rng>
Aug 01 11:54:29 user nova-compute[72178]:     <filesystem supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='driverType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>path</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>handle</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtiofs</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </filesystem>
Aug 01 11:54:29 user nova-compute[72178]:     <tpm supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-tis</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-crb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>passthrough</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>emulator</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </tpm>
Aug 01 11:54:29 user nova-compute[72178]:   </devices>
Aug 01 11:54:29 user nova-compute[72178]:   <features>
Aug 01 11:54:29 user nova-compute[72178]:     <gic supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <vmcoreinfo supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <genid supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backingStoreInput supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backup supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <sev supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:   </features>
Aug 01 11:54:29 user nova-compute[72178]: </domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 01 11:54:29 user nova-compute[72178]: <domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <path>/usr/bin/qemu-system-i386</path>
Aug 01 11:54:29 user nova-compute[72178]:   <domain>kvm</domain>
Aug 01 11:54:29 user nova-compute[72178]:   <machine>pc-i440fx-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:   <arch>i686</arch>
Aug 01 11:54:29 user nova-compute[72178]:   <vcpu max='255'/>
Aug 01 11:54:29 user nova-compute[72178]:   <iothreads supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:   <os supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='firmware'/>
Aug 01 11:54:29 user nova-compute[72178]:     <loader supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>rom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pflash</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='readonly'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='secure'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </loader>
Aug 01 11:54:29 user nova-compute[72178]:   </os>
Aug 01 11:54:29 user nova-compute[72178]:   <cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-passthrough' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='hostPassthroughMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='maximum' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='maximumMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-model' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='umip'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibpb'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibrs'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='erms'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='lm'/>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='custom' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>qemu64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>qemu32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>phenom</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>n270</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>kvm64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>coreduo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>core2duo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>athlon</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Westmere-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Westmere</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Snowridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Penryn</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G5</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G4</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G1</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Nehalem-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Rome</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Milan</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Dhyana</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cooperlake</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Conroe</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>486</model>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:   </cpu>
Aug 01 11:54:29 user nova-compute[72178]:   <memoryBacking supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='sourceType'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>file</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>anonymous</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>memfd</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:   </memoryBacking>
Aug 01 11:54:29 user nova-compute[72178]:   <devices>
Aug 01 11:54:29 user nova-compute[72178]:     <disk supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='diskDevice'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>disk</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cdrom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>floppy</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>lun</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='bus'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ide</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>fdc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sata</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </disk>
Aug 01 11:54:29 user nova-compute[72178]:     <graphics supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sdl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vnc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>spice</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egl-headless</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </graphics>
Aug 01 11:54:29 user nova-compute[72178]:     <video supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='modelType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cirrus</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vmvga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>qxl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>none</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>bochs</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ramfb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </video>
Aug 01 11:54:29 user nova-compute[72178]:     <hostdev supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='mode'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>subsystem</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='startupPolicy'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>default</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>mandatory</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>requisite</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>optional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='subsysType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pci</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='capsType'/>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='pciBackend'/>
Aug 01 11:54:29 user nova-compute[72178]:     </hostdev>
Aug 01 11:54:29 user nova-compute[72178]:     <rng supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>random</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egd</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>builtin</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </rng>
Aug 01 11:54:29 user nova-compute[72178]:     <filesystem supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='driverType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>path</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>handle</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtiofs</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </filesystem>
Aug 01 11:54:29 user nova-compute[72178]:     <tpm supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-tis</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-crb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>passthrough</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>emulator</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </tpm>
Aug 01 11:54:29 user nova-compute[72178]:   </devices>
Aug 01 11:54:29 user nova-compute[72178]:   <features>
Aug 01 11:54:29 user nova-compute[72178]:     <gic supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <vmcoreinfo supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <genid supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backingStoreInput supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backup supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <sev supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:   </features>
Aug 01 11:54:29 user nova-compute[72178]: </domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 01 11:54:29 user nova-compute[72178]: <domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 11:54:29 user nova-compute[72178]:   <domain>kvm</domain>
Aug 01 11:54:29 user nova-compute[72178]:   <machine>pc-q35-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:   <arch>x86_64</arch>
Aug 01 11:54:29 user nova-compute[72178]:   <vcpu max='288'/>
Aug 01 11:54:29 user nova-compute[72178]:   <iothreads supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:   <os supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='firmware'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>efi</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:     <loader supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>rom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pflash</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='readonly'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='secure'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </loader>
Aug 01 11:54:29 user nova-compute[72178]:   </os>
Aug 01 11:54:29 user nova-compute[72178]:   <cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-passthrough' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='hostPassthroughMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='maximum' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='maximumMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-model' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='umip'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='invtsc'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibpb'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibrs'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='rsba'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='erms'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='custom' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>qemu64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>qemu32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>phenom</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>n270</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>coreduo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>core2duo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>athlon</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Westmere</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Snowridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Penryn</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G5</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G4</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Opteron_G1</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Rome</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Milan</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Dhyana</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cooperlake</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Conroe</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>486</model>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:   </cpu>
Aug 01 11:54:29 user nova-compute[72178]:   <memoryBacking supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='sourceType'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>file</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>anonymous</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>memfd</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:   </memoryBacking>
Aug 01 11:54:29 user nova-compute[72178]:   <devices>
Aug 01 11:54:29 user nova-compute[72178]:     <disk supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='diskDevice'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>disk</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cdrom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>floppy</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>lun</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='bus'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>fdc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sata</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </disk>
Aug 01 11:54:29 user nova-compute[72178]:     <graphics supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sdl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vnc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>spice</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egl-headless</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </graphics>
Aug 01 11:54:29 user nova-compute[72178]:     <video supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='modelType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cirrus</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vmvga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>qxl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>none</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>bochs</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ramfb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </video>
Aug 01 11:54:29 user nova-compute[72178]:     <hostdev supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='mode'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>subsystem</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='startupPolicy'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>default</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>mandatory</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>requisite</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>optional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='subsysType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pci</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='capsType'/>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='pciBackend'/>
Aug 01 11:54:29 user nova-compute[72178]:     </hostdev>
Aug 01 11:54:29 user nova-compute[72178]:     <rng supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>random</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egd</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>builtin</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </rng>
Aug 01 11:54:29 user nova-compute[72178]:     <filesystem supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='driverType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>path</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>handle</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtiofs</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </filesystem>
Aug 01 11:54:29 user nova-compute[72178]:     <tpm supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-tis</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-crb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>passthrough</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>emulator</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </tpm>
Aug 01 11:54:29 user nova-compute[72178]:   </devices>
Aug 01 11:54:29 user nova-compute[72178]:   <features>
Aug 01 11:54:29 user nova-compute[72178]:     <gic supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <vmcoreinfo supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <genid supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backingStoreInput supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backup supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <sev supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:   </features>
Aug 01 11:54:29 user nova-compute[72178]: </domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 01 11:54:29 user nova-compute[72178]: <domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 11:54:29 user nova-compute[72178]:   <domain>kvm</domain>
Aug 01 11:54:29 user nova-compute[72178]:   <machine>pc-i440fx-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:   <arch>x86_64</arch>
Aug 01 11:54:29 user nova-compute[72178]:   <vcpu max='255'/>
Aug 01 11:54:29 user nova-compute[72178]:   <iothreads supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:   <os supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='firmware'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>efi</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:     <loader supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>rom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pflash</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='readonly'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='secure'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </loader>
Aug 01 11:54:29 user nova-compute[72178]:   </os>
Aug 01 11:54:29 user nova-compute[72178]:   <cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-passthrough' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='hostPassthroughMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='maximum' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='maximumMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-model' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='umip'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='invtsc'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibpb'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibrs'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='rsba'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='erms'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='custom' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>qemu64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>qemu32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>phenom</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>n270</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>coreduo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>core2duo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>athlon</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Westmere</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Snowridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Penryn</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G5</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G4</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Opteron_G1</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Rome</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Milan</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Dhyana</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cooperlake</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Conroe</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>486</model>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:   </cpu>
Aug 01 11:54:29 user nova-compute[72178]:   <memoryBacking supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='sourceType'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>file</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>anonymous</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>memfd</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:   </memoryBacking>
Aug 01 11:54:29 user nova-compute[72178]:   <devices>
Aug 01 11:54:29 user nova-compute[72178]:     <disk supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='diskDevice'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>disk</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cdrom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>floppy</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>lun</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='bus'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ide</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>fdc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sata</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </disk>
Aug 01 11:54:29 user nova-compute[72178]:     <graphics supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sdl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vnc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>spice</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egl-headless</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </graphics>
Aug 01 11:54:29 user nova-compute[72178]:     <video supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='modelType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cirrus</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vmvga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>qxl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>none</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>bochs</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ramfb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </video>
Aug 01 11:54:29 user nova-compute[72178]:     <hostdev supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='mode'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>subsystem</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='startupPolicy'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>default</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>mandatory</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>requisite</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>optional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='subsysType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pci</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='capsType'/>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='pciBackend'/>
Aug 01 11:54:29 user nova-compute[72178]:     </hostdev>
Aug 01 11:54:29 user nova-compute[72178]:     <rng supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>random</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egd</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>builtin</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </rng>
Aug 01 11:54:29 user nova-compute[72178]:     <filesystem supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='driverType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>path</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>handle</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtiofs</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </filesystem>
Aug 01 11:54:29 user nova-compute[72178]:     <tpm supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-tis</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-crb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>passthrough</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>emulator</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </tpm>
Aug 01 11:54:29 user nova-compute[72178]:   </devices>
Aug 01 11:54:29 user nova-compute[72178]:   <features>
Aug 01 11:54:29 user nova-compute[72178]:     <gic supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <vmcoreinfo supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <genid supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backingStoreInput supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backup supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <sev supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:   </features>
Aug 01 11:54:29 user nova-compute[72178]: </domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 01 11:54:29 user nova-compute[72178]: <domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 11:54:29 user nova-compute[72178]:   <domain>kvm</domain>
Aug 01 11:54:29 user nova-compute[72178]:   <machine>pc-q35-jammy</machine>
Aug 01 11:54:29 user nova-compute[72178]:   <arch>x86_64</arch>
Aug 01 11:54:29 user nova-compute[72178]:   <vcpu max='288'/>
Aug 01 11:54:29 user nova-compute[72178]:   <iothreads supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:   <os supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='firmware'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>efi</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:     <loader supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>rom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pflash</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='readonly'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='secure'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </loader>
Aug 01 11:54:29 user nova-compute[72178]:   </os>
Aug 01 11:54:29 user nova-compute[72178]:   <cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-passthrough' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='hostPassthroughMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='maximum' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='maximumMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-model' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='umip'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='invtsc'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibpb'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibrs'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='rsba'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='erms'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='custom' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>qemu64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>qemu32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>phenom</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>n270</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>coreduo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>core2duo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>athlon</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Westmere</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Snowridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Penryn</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G5</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G4</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Opteron_G1</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Rome</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Milan</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Dhyana</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cooperlake</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Conroe</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>486</model>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:   </cpu>
Aug 01 11:54:29 user nova-compute[72178]:   <memoryBacking supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='sourceType'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>file</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>anonymous</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>memfd</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:   </memoryBacking>
Aug 01 11:54:29 user nova-compute[72178]:   <devices>
Aug 01 11:54:29 user nova-compute[72178]:     <disk supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='diskDevice'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>disk</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cdrom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>floppy</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>lun</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='bus'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>fdc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sata</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </disk>
Aug 01 11:54:29 user nova-compute[72178]:     <graphics supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sdl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vnc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>spice</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egl-headless</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </graphics>
Aug 01 11:54:29 user nova-compute[72178]:     <video supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='modelType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cirrus</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vmvga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>qxl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>none</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>bochs</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ramfb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </video>
Aug 01 11:54:29 user nova-compute[72178]:     <hostdev supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='mode'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>subsystem</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='startupPolicy'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>default</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>mandatory</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>requisite</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>optional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='subsysType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pci</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='capsType'/>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='pciBackend'/>
Aug 01 11:54:29 user nova-compute[72178]:     </hostdev>
Aug 01 11:54:29 user nova-compute[72178]:     <rng supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>random</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egd</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>builtin</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </rng>
Aug 01 11:54:29 user nova-compute[72178]:     <filesystem supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='driverType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>path</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>handle</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtiofs</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </filesystem>
Aug 01 11:54:29 user nova-compute[72178]:     <tpm supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-tis</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-crb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>passthrough</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>emulator</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </tpm>
Aug 01 11:54:29 user nova-compute[72178]:   </devices>
Aug 01 11:54:29 user nova-compute[72178]:   <features>
Aug 01 11:54:29 user nova-compute[72178]:     <gic supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <vmcoreinfo supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <genid supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backingStoreInput supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backup supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <sev supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:   </features>
Aug 01 11:54:29 user nova-compute[72178]: </domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 01 11:54:29 user nova-compute[72178]: <domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 01 11:54:29 user nova-compute[72178]:   <domain>kvm</domain>
Aug 01 11:54:29 user nova-compute[72178]:   <machine>pc-i440fx-6.2</machine>
Aug 01 11:54:29 user nova-compute[72178]:   <arch>x86_64</arch>
Aug 01 11:54:29 user nova-compute[72178]:   <vcpu max='255'/>
Aug 01 11:54:29 user nova-compute[72178]:   <iothreads supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:   <os supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='firmware'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>efi</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:     <loader supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>rom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pflash</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='readonly'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>yes</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='secure'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>no</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </loader>
Aug 01 11:54:29 user nova-compute[72178]:   </os>
Aug 01 11:54:29 user nova-compute[72178]:   <cpu>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-passthrough' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='hostPassthroughMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='maximum' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='maximumMigratable'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>on</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>off</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='host-model' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <vendor>Intel</vendor>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ss'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='vmx'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pcid'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='hypervisor'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arat'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='tsc_adjust'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='umip'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='md-clear'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='arch-capabilities'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='invtsc'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibpb'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='ibrs'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-stibp'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='amd-ssbd'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='rsba'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='require' name='pschange-mc-no'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='erms'/>
Aug 01 11:54:29 user nova-compute[72178]:       <feature policy='disable' name='xsaveopt'/>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:     <mode name='custom' supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>qemu64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>qemu32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>phenom</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>pentium</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>n270</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm64</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>kvm32</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>coreduo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>core2duo</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>athlon</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Westmere-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Westmere</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Snowridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Skylake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>SandyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Penryn</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G5</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G4</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G3</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Opteron_G2</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Opteron_G1</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>IvyBridge</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Icelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Haswell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Rome</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-Milan</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC-IBPB</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>EPYC</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Dhyana</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cooperlake</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>Conroe</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Cascadelake-Server</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-noTSX</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell-IBRS</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='no'>Broadwell</model>
Aug 01 11:54:29 user nova-compute[72178]:       <model usable='yes'>486</model>
Aug 01 11:54:29 user nova-compute[72178]:     </mode>
Aug 01 11:54:29 user nova-compute[72178]:   </cpu>
Aug 01 11:54:29 user nova-compute[72178]:   <memoryBacking supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:     <enum name='sourceType'>
Aug 01 11:54:29 user nova-compute[72178]:       <value>file</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>anonymous</value>
Aug 01 11:54:29 user nova-compute[72178]:       <value>memfd</value>
Aug 01 11:54:29 user nova-compute[72178]:     </enum>
Aug 01 11:54:29 user nova-compute[72178]:   </memoryBacking>
Aug 01 11:54:29 user nova-compute[72178]:   <devices>
Aug 01 11:54:29 user nova-compute[72178]:     <disk supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='diskDevice'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>disk</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cdrom</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>floppy</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>lun</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='bus'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ide</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>fdc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sata</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </disk>
Aug 01 11:54:29 user nova-compute[72178]:     <graphics supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='type'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>sdl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vnc</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>spice</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egl-headless</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </graphics>
Aug 01 11:54:29 user nova-compute[72178]:     <video supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='modelType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>cirrus</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>vmvga</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>qxl</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>none</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>bochs</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>ramfb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </video>
Aug 01 11:54:29 user nova-compute[72178]:     <hostdev supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='mode'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>subsystem</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='startupPolicy'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>default</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>mandatory</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>requisite</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>optional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='subsysType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>usb</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>pci</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>scsi</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='capsType'/>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='pciBackend'/>
Aug 01 11:54:29 user nova-compute[72178]:     </hostdev>
Aug 01 11:54:29 user nova-compute[72178]:     <rng supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtio-non-transitional</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>random</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>egd</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>builtin</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </rng>
Aug 01 11:54:29 user nova-compute[72178]:     <filesystem supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='driverType'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>path</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>handle</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>virtiofs</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </filesystem>
Aug 01 11:54:29 user nova-compute[72178]:     <tpm supported='yes'>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='model'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-tis</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>tpm-crb</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:       <enum name='backendModel'>
Aug 01 11:54:29 user nova-compute[72178]:         <value>passthrough</value>
Aug 01 11:54:29 user nova-compute[72178]:         <value>emulator</value>
Aug 01 11:54:29 user nova-compute[72178]:       </enum>
Aug 01 11:54:29 user nova-compute[72178]:     </tpm>
Aug 01 11:54:29 user nova-compute[72178]:   </devices>
Aug 01 11:54:29 user nova-compute[72178]:   <features>
Aug 01 11:54:29 user nova-compute[72178]:     <gic supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:     <vmcoreinfo supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <genid supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backingStoreInput supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <backup supported='yes'/>
Aug 01 11:54:29 user nova-compute[72178]:     <sev supported='no'/>
Aug 01 11:54:29 user nova-compute[72178]:   </features>
Aug 01 11:54:29 user nova-compute[72178]: </domainCapabilities>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72178) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72178) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Checking secure boot support for host arch (x86_64) {{(pid=72178) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 01 11:54:29 user nova-compute[72178]: INFO nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Secure Boot support detected
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] cpu compare xml: <cpu match="exact">
Aug 01 11:54:29 user nova-compute[72178]:   <model>Nehalem</model>
Aug 01 11:54:29 user nova-compute[72178]: </cpu>
Aug 01 11:54:29 user nova-compute[72178]:  {{(pid=72178) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 01 11:54:29 user nova-compute[72178]: INFO nova.virt.node [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Generated node identity f106307e-ff81-42a0-bae9-51f40c919103
Aug 01 11:54:29 user nova-compute[72178]: INFO nova.virt.node [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Wrote node identity f106307e-ff81-42a0-bae9-51f40c919103 to /opt/stack/data/nova/compute_id
Aug 01 11:54:29 user nova-compute[72178]: WARNING nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Compute nodes ['f106307e-ff81-42a0-bae9-51f40c919103'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 01 11:54:29 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 01 11:54:29 user nova-compute[72178]: WARNING nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 01 11:54:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 11:54:29 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:54:29 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Hypervisor/Node resource view: name=user free_ram=10887MB free_disk=26.337623596191406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:54:29 user nova-compute[72178]: WARNING nova.compute.resource_tracker [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] No compute node record for user:f106307e-ff81-42a0-bae9-51f40c919103: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f106307e-ff81-42a0-bae9-51f40c919103 could not be found.
Aug 01 11:54:29 user nova-compute[72178]: INFO nova.compute.resource_tracker [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Compute node record created for user:user with uuid: f106307e-ff81-42a0-bae9-51f40c919103
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 11:54:29 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 11:54:30 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [req-26c068ed-0329-4951-a7f0-04a7d95bc3b8] Created resource provider record via placement API for resource provider with UUID f106307e-ff81-42a0-bae9-51f40c919103 and name user.
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72178) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 01 11:54:30 user nova-compute[72178]: INFO nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] kernel doesn't support AMD SEV
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Libvirt baseline CPU <cpu>
Aug 01 11:54:30 user nova-compute[72178]:   <arch>x86_64</arch>
Aug 01 11:54:30 user nova-compute[72178]:   <model>Nehalem</model>
Aug 01 11:54:30 user nova-compute[72178]:   <vendor>Intel</vendor>
Aug 01 11:54:30 user nova-compute[72178]:   <topology sockets="6" cores="1" threads="1"/>
Aug 01 11:54:30 user nova-compute[72178]: </cpu>
Aug 01 11:54:30 user nova-compute[72178]:  {{(pid=72178) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Updated inventory for provider f106307e-ff81-42a0-bae9-51f40c919103 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Updating resource provider f106307e-ff81-42a0-bae9-51f40c919103 generation from 0 to 1 during operation: update_inventory {{(pid=72178) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Updating resource provider f106307e-ff81-42a0-bae9-51f40c919103 generation from 1 to 2 during operation: update_traits {{(pid=72178) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.service [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Creating RPC server for service compute {{(pid=72178) start /opt/stack/nova/nova/service.py:182}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.service [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Join ServiceGroup membership for this service compute {{(pid=72178) start /opt/stack/nova/nova/service.py:199}}
Aug 01 11:54:30 user nova-compute[72178]: DEBUG nova.servicegroup.drivers.db [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72178) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 01 11:55:14 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_power_states {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:14 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 11:55:21 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:55:21 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=10293MB free_disk=26.241310119628906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 11:55:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:56:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 11:56:22 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:56:22 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=10234MB free_disk=26.286579132080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 11:56:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:56:23 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 11:57:23 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:57:23 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:57:23 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=26.062782287597656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:57:23 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:57:24 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 11:57:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:57:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:57:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 11:57:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 11:57:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 11:57:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 11:58:25 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:25 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=9535MB free_disk=26.09255599975586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 11:58:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:47 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:58:47 user nova-compute[72178]: INFO nova.compute.claims [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Claim successful on node user
Aug 01 11:58:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.317s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:58:48 user nova-compute[72178]: INFO nova.compute.claims [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Claim successful on node user
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:58:48 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:58:48 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Creating image(s)
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.229s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:58:48 user nova-compute[72178]: INFO nova.compute.claims [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Claim successful on node user
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.policy [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435396a1a5f54338a2af729f1e3f1754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cc7b29110b4871a9b5c6e0328bdd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0.part --force-share --output=json" returned: 0 in 0.198s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.virt.images [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] f38acd7b-c946-4724-9fc4-fe6cae069de4 was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0.part /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:58:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Creating image(s)
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.policy [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f27c80bc14843e6a250f1df6e40f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee85194306f544e8be7c1a8d2ba4656c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.052s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0.part /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0.converted" returned: 0 in 0.515s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.371s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:58:49 user nova-compute[72178]: INFO nova.compute.claims [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Claim successful on node user
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:58:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:58:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0.converted --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.260s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:49 user nova-compute[72178]: INFO oslo.privsep.daemon [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf6ywlu9_/privsep.sock']
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.192s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:49 user sudo[81600]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf6ywlu9_/privsep.sock
Aug 01 11:58:49 user sudo[81600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:58:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Creating image(s)
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "5f720460-477f-472a-904b-7a8c82bca76e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.614s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:58:50 user nova-compute[72178]: INFO nova.compute.claims [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Claim successful on node user
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.policy [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bc4265e5e5a4c50b76f755a048af7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c619872deb42eca689576a995b252e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.network.neutron [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:58:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:58:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Creating image(s)
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "/opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "/opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.policy [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c33efd008814fd98ce4154b393cf969', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f49884dd1641df8bc70177ca60dd1f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.566s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:58:50 user nova-compute[72178]: INFO nova.compute.claims [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Claim successful on node user
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:58:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:58:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:58:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Creating image(s)
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:58:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.policy [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f27c80bc14843e6a250f1df6e40f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee85194306f544e8be7c1a8d2ba4656c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:58:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Creating image(s)
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "/opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "/opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:51 user sudo[81600]: pam_unix(sudo:session): session closed for user root
Aug 01 11:58:51 user nova-compute[72178]: INFO oslo.privsep.daemon [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Spawned new privsep daemon via rootwrap
Aug 01 11:58:51 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 11:58:51 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 11:58:51 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 01 11:58:51 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81603
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:58:51 user nova-compute[72178]: WARNING oslo_privsep.priv_context [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] privsep daemon already running
Aug 01 11:58:51 user nova-compute[72178]: WARNING oslo_privsep.priv_context [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] privsep daemon already running
Aug 01 11:58:51 user nova-compute[72178]: WARNING oslo_privsep.priv_context [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] privsep daemon already running
Aug 01 11:58:51 user nova-compute[72178]: WARNING oslo_privsep.priv_context [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] privsep daemon already running
Aug 01 11:58:51 user nova-compute[72178]: DEBUG nova.policy [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec0992e3a27a4a44922268a46b27ad83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2fc3212d24561b0b971241fe367ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:58:51 user nova-compute[72178]: WARNING oslo_privsep.priv_context [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] privsep daemon already running
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.213s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.176s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:58:52 user nova-compute[72178]: INFO nova.compute.claims [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Claim successful on node user
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.168s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.200s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk 1073741824" returned: 0 in 0.045s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.196s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk 1073741824" returned: 0 in 0.082s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.444s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Cannot resize image /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'migration_context' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Ensure instance console log exists: /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.185s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Successfully created port: 326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Successfully created port: c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.923s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk 1073741824" returned: 0 in 0.059s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.435s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Successfully created port: c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.734s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Cannot resize image /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'migration_context' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:58:52 user nova-compute[72178]: INFO nova.compute.claims [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Claim successful on node user
Aug 01 11:58:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Ensure instance console log exists: /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:58:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Successfully created port: 1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.188s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk 1073741824" returned: 0 in 0.045s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.017s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:58:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Creating image(s)
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Successfully created port: 39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Cannot resize image /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'migration_context' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Ensure instance console log exists: /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.policy [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '822801b8c40b40b1a49fbdd859575f1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cafcb07520f4031a1902defc1d5a5e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.194s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.190s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk 1073741824" returned: 0 in 0.054s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.255s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Cannot resize image /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lazy-loading 'migration_context' on Instance uuid fc8d64a1-321c-45d7-9db3-1159c91ee9b7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Ensure instance console log exists: /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.172s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.832s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk 1073741824" returned: 0 in 0.051s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.307s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Cannot resize image /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'migration_context' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Ensure instance console log exists: /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk 1073741824" returned: 0 in 0.045s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Cannot resize image /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'migration_context' on Instance uuid 5f720460-477f-472a-904b-7a8c82bca76e {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Successfully created port: 729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Ensure instance console log exists: /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:58:54 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Creating image(s)
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.policy [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57295306c0f44b0db27c9eb0c3ac8b6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b58e90c2bb974b6a9be977ac0ce46828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.122s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Cannot resize image /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'migration_context' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Ensure instance console log exists: /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk 1073741824" returned: 0 in 0.049s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Cannot resize image /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'migration_context' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Ensure instance console log exists: /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Successfully updated port: c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "refresh_cache-fc8d64a1-321c-45d7-9db3-1159c91ee9b7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquired lock "refresh_cache-fc8d64a1-321c-45d7-9db3-1159c91ee9b7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-2365d079-d3d7-4565-9409-79eaf98174c5 req-7cd291e0-b9f5-4e3a-bb6e-a5a2a9312709 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received event network-changed-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-2365d079-d3d7-4565-9409-79eaf98174c5 req-7cd291e0-b9f5-4e3a-bb6e-a5a2a9312709 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Refreshing instance network info cache due to event network-changed-c4409dd6-d612-428b-b219-fa81b4040453. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2365d079-d3d7-4565-9409-79eaf98174c5 req-7cd291e0-b9f5-4e3a-bb6e-a5a2a9312709 service nova] Acquiring lock "refresh_cache-fc8d64a1-321c-45d7-9db3-1159c91ee9b7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Successfully updated port: 326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquired lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Updating instance_info_cache with network_info: [{"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Releasing lock "refresh_cache-fc8d64a1-321c-45d7-9db3-1159c91ee9b7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Instance network_info: |[{"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2365d079-d3d7-4565-9409-79eaf98174c5 req-7cd291e0-b9f5-4e3a-bb6e-a5a2a9312709 service nova] Acquired lock "refresh_cache-fc8d64a1-321c-45d7-9db3-1159c91ee9b7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.neutron [req-2365d079-d3d7-4565-9409-79eaf98174c5 req-7cd291e0-b9f5-4e3a-bb6e-a5a2a9312709 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Refreshing network info cache for port c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Start _get_guest_xml network_info=[{"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:58:55 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:55 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1918072023',display_name='tempest-DeleteServersTestJSON-server-1918072023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1918072023',id=4,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f49884dd1641df8bc70177ca60dd1f',ramdisk_id='',reservation_id='r-0feaprwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-452553089',owner_user_name='tempest-DeleteServersTestJSON-452553089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:51Z,user_data=None,user_id='1c33efd008814fd98ce4154b393cf969',uuid=fc8d64a1-321c-45d7-9db3-1159c91ee9b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Converting VIF {"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b7:da,bridge_name='br-int',has_traffic_filtering=True,id=c4409dd6-d612-428b-b219-fa81b4040453,network=Network(03c67f25-9337-4fa6-bdcb-54abe38b50ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4409dd6-d6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.objects.instance [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lazy-loading 'pci_devices' on Instance uuid fc8d64a1-321c-45d7-9db3-1159c91ee9b7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Successfully updated port: 39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquired lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:58:55 user nova-compute[72178]:   <uuid>fc8d64a1-321c-45d7-9db3-1159c91ee9b7</uuid>
Aug 01 11:58:55 user nova-compute[72178]:   <name>instance-00000004</name>
Aug 01 11:58:55 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:58:55 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:58:55 user nova-compute[72178]:   <metadata>
Aug 01 11:58:55 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:58:55 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:58:55 user nova-compute[72178]:       <nova:name>tempest-DeleteServersTestJSON-server-1918072023</nova:name>
Aug 01 11:58:55 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:58:55</nova:creationTime>
Aug 01 11:58:55 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:58:55 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:58:55 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:58:55 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:58:55 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:58:55 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:58:55 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:58:55 user nova-compute[72178]:       <nova:owner>
Aug 01 11:58:55 user nova-compute[72178]:         <nova:user uuid="1c33efd008814fd98ce4154b393cf969">tempest-DeleteServersTestJSON-452553089-project-member</nova:user>
Aug 01 11:58:55 user nova-compute[72178]:         <nova:project uuid="f7f49884dd1641df8bc70177ca60dd1f">tempest-DeleteServersTestJSON-452553089</nova:project>
Aug 01 11:58:55 user nova-compute[72178]:       </nova:owner>
Aug 01 11:58:55 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:58:55 user nova-compute[72178]:       <nova:ports>
Aug 01 11:58:55 user nova-compute[72178]:         <nova:port uuid="c4409dd6-d612-428b-b219-fa81b4040453">
Aug 01 11:58:55 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 11:58:55 user nova-compute[72178]:         </nova:port>
Aug 01 11:58:55 user nova-compute[72178]:       </nova:ports>
Aug 01 11:58:55 user nova-compute[72178]:     </nova:instance>
Aug 01 11:58:55 user nova-compute[72178]:   </metadata>
Aug 01 11:58:55 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:58:55 user nova-compute[72178]:     <system>
Aug 01 11:58:55 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:58:55 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:58:55 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:58:55 user nova-compute[72178]:       <entry name="serial">fc8d64a1-321c-45d7-9db3-1159c91ee9b7</entry>
Aug 01 11:58:55 user nova-compute[72178]:       <entry name="uuid">fc8d64a1-321c-45d7-9db3-1159c91ee9b7</entry>
Aug 01 11:58:55 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:58:55 user nova-compute[72178]:     </system>
Aug 01 11:58:55 user nova-compute[72178]:   </sysinfo>
Aug 01 11:58:55 user nova-compute[72178]:   <os>
Aug 01 11:58:55 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:58:55 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:58:55 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:58:55 user nova-compute[72178]:   </os>
Aug 01 11:58:55 user nova-compute[72178]:   <features>
Aug 01 11:58:55 user nova-compute[72178]:     <acpi/>
Aug 01 11:58:55 user nova-compute[72178]:     <apic/>
Aug 01 11:58:55 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:58:55 user nova-compute[72178]:   </features>
Aug 01 11:58:55 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:58:55 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:58:55 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:58:55 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:58:55 user nova-compute[72178]:   </clock>
Aug 01 11:58:55 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:58:55 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:58:55 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:58:55 user nova-compute[72178]:   </cpu>
Aug 01 11:58:55 user nova-compute[72178]:   <devices>
Aug 01 11:58:55 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:58:55 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:58:55 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk"/>
Aug 01 11:58:55 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:58:55 user nova-compute[72178]:     </disk>
Aug 01 11:58:55 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:58:55 user nova-compute[72178]:       <mac address="fa:16:3e:ae:b7:da"/>
Aug 01 11:58:55 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:55 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:58:55 user nova-compute[72178]:       <target dev="tapc4409dd6-d6"/>
Aug 01 11:58:55 user nova-compute[72178]:     </interface>
Aug 01 11:58:55 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:58:55 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/console.log" append="off"/>
Aug 01 11:58:55 user nova-compute[72178]:     </serial>
Aug 01 11:58:55 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:58:55 user nova-compute[72178]:     <video>
Aug 01 11:58:55 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:55 user nova-compute[72178]:     </video>
Aug 01 11:58:55 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:58:55 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:58:55 user nova-compute[72178]:     </rng>
Aug 01 11:58:55 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:58:55 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:58:55 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:58:55 user nova-compute[72178]:     </memballoon>
Aug 01 11:58:55 user nova-compute[72178]:   </devices>
Aug 01 11:58:55 user nova-compute[72178]: </domain>
Aug 01 11:58:55 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1918072023',display_name='tempest-DeleteServersTestJSON-server-1918072023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1918072023',id=4,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f49884dd1641df8bc70177ca60dd1f',ramdisk_id='',reservation_id='r-0feaprwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-452553089',owner_user_name='tempest-DeleteServersTestJSON-452553089-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:51Z,user_data=None,user_id='1c33efd008814fd98ce4154b393cf969',uuid=fc8d64a1-321c-45d7-9db3-1159c91ee9b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Converting VIF {"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b7:da,bridge_name='br-int',has_traffic_filtering=True,id=c4409dd6-d612-428b-b219-fa81b4040453,network=Network(03c67f25-9337-4fa6-bdcb-54abe38b50ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4409dd6-d6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG os_vif [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b7:da,bridge_name='br-int',has_traffic_filtering=True,id=c4409dd6-d612-428b-b219-fa81b4040453,network=Network(03c67f25-9337-4fa6-bdcb-54abe38b50ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4409dd6-d6') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Created schema index Interface.name {{(pid=72178) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Created schema index Port.name {{(pid=72178) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Created schema index Bridge.name {{(pid=72178) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [POLLOUT] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:58:56 user nova-compute[72178]: INFO oslo.privsep.daemon [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpyjyv8cud/privsep.sock']
Aug 01 11:58:56 user sudo[81734]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpyjyv8cud/privsep.sock
Aug 01 11:58:56 user sudo[81734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 11:58:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Successfully updated port: 729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquired lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Successfully created port: 5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-5406d8f9-9b8b-493e-a5a6-f4a9d9ea4377 req-9a9a33fe-3a9a-4dec-89b7-c11c2139c763 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-changed-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-5406d8f9-9b8b-493e-a5a6-f4a9d9ea4377 req-9a9a33fe-3a9a-4dec-89b7-c11c2139c763 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Refreshing instance network info cache due to event network-changed-729998f1-8451-468a-a2d8-8612146ac1e3. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:58:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5406d8f9-9b8b-493e-a5a6-f4a9d9ea4377 req-9a9a33fe-3a9a-4dec-89b7-c11c2139c763 service nova] Acquiring lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Releasing lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance network_info: |[{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Start _get_guest_xml network_info=[{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:58:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2025863266',display_name='tempest-ServerActionsTestOtherA-server-2025863266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2025863266',id=3,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-a1thrv1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=84869969-6058-4000-808e-7ccb4ea10aa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'pci_devices' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:58:57 user nova-compute[72178]:   <uuid>84869969-6058-4000-808e-7ccb4ea10aa9</uuid>
Aug 01 11:58:57 user nova-compute[72178]:   <name>instance-00000003</name>
Aug 01 11:58:57 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:58:57 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:58:57 user nova-compute[72178]:   <metadata>
Aug 01 11:58:57 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:58:57 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:name>tempest-ServerActionsTestOtherA-server-2025863266</nova:name>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:58:57</nova:creationTime>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:58:57 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:owner>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:user uuid="5bc4265e5e5a4c50b76f755a048af7b4">tempest-ServerActionsTestOtherA-709464081-project-member</nova:user>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:project uuid="c4c619872deb42eca689576a995b252e">tempest-ServerActionsTestOtherA-709464081</nova:project>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:owner>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:ports>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:port uuid="326dc903-e97e-4cde-bd42-5145785c4f92">
Aug 01 11:58:57 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 11:58:57 user nova-compute[72178]:         </nova:port>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:ports>
Aug 01 11:58:57 user nova-compute[72178]:     </nova:instance>
Aug 01 11:58:57 user nova-compute[72178]:   </metadata>
Aug 01 11:58:57 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:58:57 user nova-compute[72178]:     <system>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="serial">84869969-6058-4000-808e-7ccb4ea10aa9</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="uuid">84869969-6058-4000-808e-7ccb4ea10aa9</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:58:57 user nova-compute[72178]:     </system>
Aug 01 11:58:57 user nova-compute[72178]:   </sysinfo>
Aug 01 11:58:57 user nova-compute[72178]:   <os>
Aug 01 11:58:57 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:58:57 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:58:57 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:58:57 user nova-compute[72178]:   </os>
Aug 01 11:58:57 user nova-compute[72178]:   <features>
Aug 01 11:58:57 user nova-compute[72178]:     <acpi/>
Aug 01 11:58:57 user nova-compute[72178]:     <apic/>
Aug 01 11:58:57 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:58:57 user nova-compute[72178]:   </features>
Aug 01 11:58:57 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:58:57 user nova-compute[72178]:   </clock>
Aug 01 11:58:57 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:58:57 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:58:57 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:58:57 user nova-compute[72178]:   </cpu>
Aug 01 11:58:57 user nova-compute[72178]:   <devices>
Aug 01 11:58:57 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:58:57 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:58:57 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk"/>
Aug 01 11:58:57 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:     </disk>
Aug 01 11:58:57 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:58:57 user nova-compute[72178]:       <mac address="fa:16:3e:1a:f9:b8"/>
Aug 01 11:58:57 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:58:57 user nova-compute[72178]:       <target dev="tap326dc903-e9"/>
Aug 01 11:58:57 user nova-compute[72178]:     </interface>
Aug 01 11:58:57 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:58:57 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/console.log" append="off"/>
Aug 01 11:58:57 user nova-compute[72178]:     </serial>
Aug 01 11:58:57 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:58:57 user nova-compute[72178]:     <video>
Aug 01 11:58:57 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:     </video>
Aug 01 11:58:57 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:58:57 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:58:57 user nova-compute[72178]:     </rng>
Aug 01 11:58:57 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:58:57 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:58:57 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:58:57 user nova-compute[72178]:     </memballoon>
Aug 01 11:58:57 user nova-compute[72178]:   </devices>
Aug 01 11:58:57 user nova-compute[72178]: </domain>
Aug 01 11:58:57 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2025863266',display_name='tempest-ServerActionsTestOtherA-server-2025863266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2025863266',id=3,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-a1thrv1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=84869969-6058-4000-808e-7ccb4ea10aa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG os_vif [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-changed-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Refreshing instance network info cache due to event network-changed-326dc903-e97e-4cde-bd42-5145785c4f92. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] Acquiring lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] Acquired lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Refreshing network info cache for port 326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updating instance_info_cache with network_info: [{"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Releasing lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Instance network_info: |[{"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Start _get_guest_xml network_info=[{"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:58:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-388288203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-388288203',id=6,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-n34sr5b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:52Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=5f720460-477f-472a-904b-7a8c82bca76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=39bff660-0a48-4f81-a38f-a10af4afd7f8,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bff660-0a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f720460-477f-472a-904b-7a8c82bca76e {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:58:57 user nova-compute[72178]:   <uuid>5f720460-477f-472a-904b-7a8c82bca76e</uuid>
Aug 01 11:58:57 user nova-compute[72178]:   <name>instance-00000006</name>
Aug 01 11:58:57 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:58:57 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:58:57 user nova-compute[72178]:   <metadata>
Aug 01 11:58:57 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:58:57 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-388288203</nova:name>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:58:57</nova:creationTime>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:58:57 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:owner>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:user uuid="ec0992e3a27a4a44922268a46b27ad83">tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member</nova:user>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:project uuid="d5e2fc3212d24561b0b971241fe367ec">tempest-ServerBootFromVolumeStableRescueTest-2013636577</nova:project>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:owner>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:ports>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:port uuid="39bff660-0a48-4f81-a38f-a10af4afd7f8">
Aug 01 11:58:57 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 11:58:57 user nova-compute[72178]:         </nova:port>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:ports>
Aug 01 11:58:57 user nova-compute[72178]:     </nova:instance>
Aug 01 11:58:57 user nova-compute[72178]:   </metadata>
Aug 01 11:58:57 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:58:57 user nova-compute[72178]:     <system>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="serial">5f720460-477f-472a-904b-7a8c82bca76e</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="uuid">5f720460-477f-472a-904b-7a8c82bca76e</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:58:57 user nova-compute[72178]:     </system>
Aug 01 11:58:57 user nova-compute[72178]:   </sysinfo>
Aug 01 11:58:57 user nova-compute[72178]:   <os>
Aug 01 11:58:57 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:58:57 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:58:57 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:58:57 user nova-compute[72178]:   </os>
Aug 01 11:58:57 user nova-compute[72178]:   <features>
Aug 01 11:58:57 user nova-compute[72178]:     <acpi/>
Aug 01 11:58:57 user nova-compute[72178]:     <apic/>
Aug 01 11:58:57 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:58:57 user nova-compute[72178]:   </features>
Aug 01 11:58:57 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:58:57 user nova-compute[72178]:   </clock>
Aug 01 11:58:57 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:58:57 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:58:57 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:58:57 user nova-compute[72178]:   </cpu>
Aug 01 11:58:57 user nova-compute[72178]:   <devices>
Aug 01 11:58:57 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:58:57 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:58:57 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk"/>
Aug 01 11:58:57 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:     </disk>
Aug 01 11:58:57 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:58:57 user nova-compute[72178]:       <mac address="fa:16:3e:bd:c9:7a"/>
Aug 01 11:58:57 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:58:57 user nova-compute[72178]:       <target dev="tap39bff660-0a"/>
Aug 01 11:58:57 user nova-compute[72178]:     </interface>
Aug 01 11:58:57 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:58:57 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/console.log" append="off"/>
Aug 01 11:58:57 user nova-compute[72178]:     </serial>
Aug 01 11:58:57 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:58:57 user nova-compute[72178]:     <video>
Aug 01 11:58:57 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:     </video>
Aug 01 11:58:57 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:58:57 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:58:57 user nova-compute[72178]:     </rng>
Aug 01 11:58:57 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:58:57 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:58:57 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:58:57 user nova-compute[72178]:     </memballoon>
Aug 01 11:58:57 user nova-compute[72178]:   </devices>
Aug 01 11:58:57 user nova-compute[72178]: </domain>
Aug 01 11:58:57 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-388288203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-388288203',id=6,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-n34sr5b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:52Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=5f720460-477f-472a-904b-7a8c82bca76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=39bff660-0a48-4f81-a38f-a10af4afd7f8,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bff660-0a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG os_vif [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=39bff660-0a48-4f81-a38f-a10af4afd7f8,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bff660-0a') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updating instance_info_cache with network_info: [{"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Releasing lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Instance network_info: |[{"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5406d8f9-9b8b-493e-a5a6-f4a9d9ea4377 req-9a9a33fe-3a9a-4dec-89b7-c11c2139c763 service nova] Acquired lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-5406d8f9-9b8b-493e-a5a6-f4a9d9ea4377 req-9a9a33fe-3a9a-4dec-89b7-c11c2139c763 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Refreshing network info cache for port 729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Start _get_guest_xml network_info=[{"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:58:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-187040838',display_name='tempest-ServerRescueNegativeTestJSON-server-187040838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-187040838',id=5,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-r0egeg4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:51Z,user_data=None,user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=326f0759-29ce-4441-ba2a-7a74d8726eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3c:55,bridge_name='br-int',has_traffic_filtering=True,id=729998f1-8451-468a-a2d8-8612146ac1e3,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap729998f1-84') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'pci_devices' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Successfully created port: af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:58:57 user nova-compute[72178]:   <uuid>326f0759-29ce-4441-ba2a-7a74d8726eb7</uuid>
Aug 01 11:58:57 user nova-compute[72178]:   <name>instance-00000005</name>
Aug 01 11:58:57 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:58:57 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:58:57 user nova-compute[72178]:   <metadata>
Aug 01 11:58:57 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:58:57 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-187040838</nova:name>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:58:57</nova:creationTime>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:58:57 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:owner>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:user uuid="6f27c80bc14843e6a250f1df6e40f26f">tempest-ServerRescueNegativeTestJSON-1377634293-project-member</nova:user>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:project uuid="ee85194306f544e8be7c1a8d2ba4656c">tempest-ServerRescueNegativeTestJSON-1377634293</nova:project>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:owner>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:58:57 user nova-compute[72178]:       <nova:ports>
Aug 01 11:58:57 user nova-compute[72178]:         <nova:port uuid="729998f1-8451-468a-a2d8-8612146ac1e3">
Aug 01 11:58:57 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 11:58:57 user nova-compute[72178]:         </nova:port>
Aug 01 11:58:57 user nova-compute[72178]:       </nova:ports>
Aug 01 11:58:57 user nova-compute[72178]:     </nova:instance>
Aug 01 11:58:57 user nova-compute[72178]:   </metadata>
Aug 01 11:58:57 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:58:57 user nova-compute[72178]:     <system>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="serial">326f0759-29ce-4441-ba2a-7a74d8726eb7</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="uuid">326f0759-29ce-4441-ba2a-7a74d8726eb7</entry>
Aug 01 11:58:57 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:58:57 user nova-compute[72178]:     </system>
Aug 01 11:58:57 user nova-compute[72178]:   </sysinfo>
Aug 01 11:58:57 user nova-compute[72178]:   <os>
Aug 01 11:58:57 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:58:57 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:58:57 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:58:57 user nova-compute[72178]:   </os>
Aug 01 11:58:57 user nova-compute[72178]:   <features>
Aug 01 11:58:57 user nova-compute[72178]:     <acpi/>
Aug 01 11:58:57 user nova-compute[72178]:     <apic/>
Aug 01 11:58:57 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:58:57 user nova-compute[72178]:   </features>
Aug 01 11:58:57 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:58:57 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:58:57 user nova-compute[72178]:   </clock>
Aug 01 11:58:57 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:58:57 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:58:57 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:58:57 user nova-compute[72178]:   </cpu>
Aug 01 11:58:57 user nova-compute[72178]:   <devices>
Aug 01 11:58:57 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:58:57 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:58:57 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk"/>
Aug 01 11:58:57 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:     </disk>
Aug 01 11:58:57 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:58:57 user nova-compute[72178]:       <mac address="fa:16:3e:c3:3c:55"/>
Aug 01 11:58:57 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:58:57 user nova-compute[72178]:       <target dev="tap729998f1-84"/>
Aug 01 11:58:57 user nova-compute[72178]:     </interface>
Aug 01 11:58:57 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:58:57 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/console.log" append="off"/>
Aug 01 11:58:57 user nova-compute[72178]:     </serial>
Aug 01 11:58:57 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:58:57 user nova-compute[72178]:     <video>
Aug 01 11:58:57 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:57 user nova-compute[72178]:     </video>
Aug 01 11:58:57 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:58:57 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:58:57 user nova-compute[72178]:     </rng>
Aug 01 11:58:57 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:58:57 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:58:57 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:58:57 user nova-compute[72178]:     </memballoon>
Aug 01 11:58:57 user nova-compute[72178]:   </devices>
Aug 01 11:58:57 user nova-compute[72178]: </domain>
Aug 01 11:58:57 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-187040838',display_name='tempest-ServerRescueNegativeTestJSON-server-187040838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-187040838',id=5,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-r0egeg4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:51Z,user_data=None,user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=326f0759-29ce-4441-ba2a-7a74d8726eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3c:55,bridge_name='br-int',has_traffic_filtering=True,id=729998f1-8451-468a-a2d8-8612146ac1e3,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap729998f1-84') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG os_vif [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3c:55,bridge_name='br-int',has_traffic_filtering=True,id=729998f1-8451-468a-a2d8-8612146ac1e3,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap729998f1-84') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-2365d079-d3d7-4565-9409-79eaf98174c5 req-7cd291e0-b9f5-4e3a-bb6e-a5a2a9312709 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Updated VIF entry in instance network info cache for port c4409dd6-d612-428b-b219-fa81b4040453. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:58:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-2365d079-d3d7-4565-9409-79eaf98174c5 req-7cd291e0-b9f5-4e3a-bb6e-a5a2a9312709 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Updating instance_info_cache with network_info: [{"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:57 user sudo[81734]: pam_unix(sudo:session): session closed for user root
Aug 01 11:58:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2365d079-d3d7-4565-9409-79eaf98174c5 req-7cd291e0-b9f5-4e3a-bb6e-a5a2a9312709 service nova] Releasing lock "refresh_cache-fc8d64a1-321c-45d7-9db3-1159c91ee9b7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:57 user nova-compute[72178]: INFO oslo.privsep.daemon [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Spawned new privsep daemon via rootwrap
Aug 01 11:58:57 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 11:58:57 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 11:58:57 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 01 11:58:57 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81738
Aug 01 11:58:57 user nova-compute[72178]: WARNING oslo_privsep.priv_context [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] privsep daemon already running
Aug 01 11:58:57 user nova-compute[72178]: WARNING oslo_privsep.priv_context [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] privsep daemon already running
Aug 01 11:58:57 user nova-compute[72178]: WARNING oslo_privsep.priv_context [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] privsep daemon already running
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Successfully updated port: c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquired lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updated VIF entry in instance network info cache for port 326dc903-e97e-4cde-bd42-5145785c4f92. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] Releasing lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received event network-changed-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Refreshing instance network info cache due to event network-changed-39bff660-0a48-4f81-a38f-a10af4afd7f8. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] Acquiring lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] Acquired lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Refreshing network info cache for port 39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Successfully updated port: 1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-c1b4b71d-b692-4212-8eac-db1ea0759362 req-fdb1cd0f-5337-4c0a-a7a0-a2d17f3698e1 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-changed-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-c1b4b71d-b692-4212-8eac-db1ea0759362 req-fdb1cd0f-5337-4c0a-a7a0-a2d17f3698e1 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Refreshing instance network info cache due to event network-changed-c3d72fdf-8035-4c64-8514-366e8e6b2b51. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c1b4b71d-b692-4212-8eac-db1ea0759362 req-fdb1cd0f-5337-4c0a-a7a0-a2d17f3698e1 service nova] Acquiring lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4409dd6-d6, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4409dd6-d6, col_values=(('external_ids', {'iface-id': 'c4409dd6-d612-428b-b219-fa81b4040453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:b7:da', 'vm-uuid': 'fc8d64a1-321c-45d7-9db3-1159c91ee9b7'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: INFO os_vif [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b7:da,bridge_name='br-int',has_traffic_filtering=True,id=c4409dd6-d612-428b-b219-fa81b4040453,network=Network(03c67f25-9337-4fa6-bdcb-54abe38b50ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4409dd6-d6')
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39bff660-0a, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39bff660-0a, col_values=(('external_ids', {'iface-id': '39bff660-0a48-4f81-a38f-a10af4afd7f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:c9:7a', 'vm-uuid': '5f720460-477f-472a-904b-7a8c82bca76e'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquired lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: INFO os_vif [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=39bff660-0a48-4f81-a38f-a10af4afd7f8,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bff660-0a')
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap326dc903-e9, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap326dc903-e9, col_values=(('external_ids', {'iface-id': '326dc903-e97e-4cde-bd42-5145785c4f92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:f9:b8', 'vm-uuid': '84869969-6058-4000-808e-7ccb4ea10aa9'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: INFO os_vif [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9')
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap729998f1-84, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap729998f1-84, col_values=(('external_ids', {'iface-id': '729998f1-8451-468a-a2d8-8612146ac1e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:3c:55', 'vm-uuid': '326f0759-29ce-4441-ba2a-7a74d8726eb7'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:58 user nova-compute[72178]: INFO os_vif [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:3c:55,bridge_name='br-int',has_traffic_filtering=True,id=729998f1-8451-468a-a2d8-8612146ac1e3,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap729998f1-84')
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] No VIF found with MAC fa:16:3e:ae:b7:da, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No VIF found with MAC fa:16:3e:bd:c9:7a, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No VIF found with MAC fa:16:3e:1a:f9:b8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No VIF found with MAC fa:16:3e:c3:3c:55, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-5406d8f9-9b8b-493e-a5a6-f4a9d9ea4377 req-9a9a33fe-3a9a-4dec-89b7-c11c2139c763 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updated VIF entry in instance network info cache for port 729998f1-8451-468a-a2d8-8612146ac1e3. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-5406d8f9-9b8b-493e-a5a6-f4a9d9ea4377 req-9a9a33fe-3a9a-4dec-89b7-c11c2139c763 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updating instance_info_cache with network_info: [{"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5406d8f9-9b8b-493e-a5a6-f4a9d9ea4377 req-9a9a33fe-3a9a-4dec-89b7-c11c2139c763 service nova] Releasing lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:58 user nova-compute[72178]: DEBUG nova.network.neutron [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Successfully updated port: 5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquired lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.neutron [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-397f13c7-bc2c-4021-ae59-3ccd50ce438d req-fb771be3-489a-45fd-9102-6bc1f955cee3 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-changed-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-397f13c7-bc2c-4021-ae59-3ccd50ce438d req-fb771be3-489a-45fd-9102-6bc1f955cee3 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Refreshing instance network info cache due to event network-changed-5f9f171c-75e5-4362-8075-9051f6fbcabe. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-397f13c7-bc2c-4021-ae59-3ccd50ce438d req-fb771be3-489a-45fd-9102-6bc1f955cee3 service nova] Acquiring lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.neutron [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updating instance_info_cache with network_info: [{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Releasing lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance network_info: |[{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Start _get_guest_xml network_info=[{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:58:59 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:59 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1723458725',display_name='tempest-ServerRescueNegativeTestJSON-server-1723458725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1723458725',id=2,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-rmm0o2wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:49Z,user_data=None,user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=8ac32412-1f05-4d62-a184-0b90f1b3d21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7a:b7,bridge_name='br-int',has_traffic_filtering=True,id=1d37f04c-d365-4720-ace0-73d2cdd79af2,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d37f04c-d3') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:58:59 user nova-compute[72178]:   <uuid>8ac32412-1f05-4d62-a184-0b90f1b3d21c</uuid>
Aug 01 11:58:59 user nova-compute[72178]:   <name>instance-00000002</name>
Aug 01 11:58:59 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:58:59 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:58:59 user nova-compute[72178]:   <metadata>
Aug 01 11:58:59 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:58:59 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:58:59 user nova-compute[72178]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1723458725</nova:name>
Aug 01 11:58:59 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:58:59</nova:creationTime>
Aug 01 11:58:59 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:58:59 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:58:59 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:58:59 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:58:59 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:58:59 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:58:59 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:58:59 user nova-compute[72178]:       <nova:owner>
Aug 01 11:58:59 user nova-compute[72178]:         <nova:user uuid="6f27c80bc14843e6a250f1df6e40f26f">tempest-ServerRescueNegativeTestJSON-1377634293-project-member</nova:user>
Aug 01 11:58:59 user nova-compute[72178]:         <nova:project uuid="ee85194306f544e8be7c1a8d2ba4656c">tempest-ServerRescueNegativeTestJSON-1377634293</nova:project>
Aug 01 11:58:59 user nova-compute[72178]:       </nova:owner>
Aug 01 11:58:59 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:58:59 user nova-compute[72178]:       <nova:ports>
Aug 01 11:58:59 user nova-compute[72178]:         <nova:port uuid="1d37f04c-d365-4720-ace0-73d2cdd79af2">
Aug 01 11:58:59 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 11:58:59 user nova-compute[72178]:         </nova:port>
Aug 01 11:58:59 user nova-compute[72178]:       </nova:ports>
Aug 01 11:58:59 user nova-compute[72178]:     </nova:instance>
Aug 01 11:58:59 user nova-compute[72178]:   </metadata>
Aug 01 11:58:59 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:58:59 user nova-compute[72178]:     <system>
Aug 01 11:58:59 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:58:59 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:58:59 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:58:59 user nova-compute[72178]:       <entry name="serial">8ac32412-1f05-4d62-a184-0b90f1b3d21c</entry>
Aug 01 11:58:59 user nova-compute[72178]:       <entry name="uuid">8ac32412-1f05-4d62-a184-0b90f1b3d21c</entry>
Aug 01 11:58:59 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:58:59 user nova-compute[72178]:     </system>
Aug 01 11:58:59 user nova-compute[72178]:   </sysinfo>
Aug 01 11:58:59 user nova-compute[72178]:   <os>
Aug 01 11:58:59 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:58:59 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:58:59 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:58:59 user nova-compute[72178]:   </os>
Aug 01 11:58:59 user nova-compute[72178]:   <features>
Aug 01 11:58:59 user nova-compute[72178]:     <acpi/>
Aug 01 11:58:59 user nova-compute[72178]:     <apic/>
Aug 01 11:58:59 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:58:59 user nova-compute[72178]:   </features>
Aug 01 11:58:59 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:58:59 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:58:59 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:58:59 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:58:59 user nova-compute[72178]:   </clock>
Aug 01 11:58:59 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:58:59 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:58:59 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:58:59 user nova-compute[72178]:   </cpu>
Aug 01 11:58:59 user nova-compute[72178]:   <devices>
Aug 01 11:58:59 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:58:59 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:58:59 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk"/>
Aug 01 11:58:59 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:58:59 user nova-compute[72178]:     </disk>
Aug 01 11:58:59 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:58:59 user nova-compute[72178]:       <mac address="fa:16:3e:fc:7a:b7"/>
Aug 01 11:58:59 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:59 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:58:59 user nova-compute[72178]:       <target dev="tap1d37f04c-d3"/>
Aug 01 11:58:59 user nova-compute[72178]:     </interface>
Aug 01 11:58:59 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:58:59 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/console.log" append="off"/>
Aug 01 11:58:59 user nova-compute[72178]:     </serial>
Aug 01 11:58:59 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:58:59 user nova-compute[72178]:     <video>
Aug 01 11:58:59 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:58:59 user nova-compute[72178]:     </video>
Aug 01 11:58:59 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:58:59 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:58:59 user nova-compute[72178]:     </rng>
Aug 01 11:58:59 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:58:59 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:58:59 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:58:59 user nova-compute[72178]:     </memballoon>
Aug 01 11:58:59 user nova-compute[72178]:   </devices>
Aug 01 11:58:59 user nova-compute[72178]: </domain>
Aug 01 11:58:59 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1723458725',display_name='tempest-ServerRescueNegativeTestJSON-server-1723458725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1723458725',id=2,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-rmm0o2wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:49Z,user_data=None,user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=8ac32412-1f05-4d62-a184-0b90f1b3d21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7a:b7,bridge_name='br-int',has_traffic_filtering=True,id=1d37f04c-d365-4720-ace0-73d2cdd79af2,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d37f04c-d3') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG os_vif [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7a:b7,bridge_name='br-int',has_traffic_filtering=True,id=1d37f04c-d365-4720-ace0-73d2cdd79af2,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d37f04c-d3') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d37f04c-d3, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d37f04c-d3, col_values=(('external_ids', {'iface-id': '1d37f04c-d365-4720-ace0-73d2cdd79af2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:7a:b7', 'vm-uuid': '8ac32412-1f05-4d62-a184-0b90f1b3d21c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:58:59 user nova-compute[72178]: INFO os_vif [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7a:b7,bridge_name='br-int',has_traffic_filtering=True,id=1d37f04c-d365-4720-ace0-73d2cdd79af2,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d37f04c-d3')
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No VIF found with MAC fa:16:3e:fc:7a:b7, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.neutron [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Releasing lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance network_info: |[{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-397f13c7-bc2c-4021-ae59-3ccd50ce438d req-fb771be3-489a-45fd-9102-6bc1f955cee3 service nova] Acquired lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.network.neutron [req-397f13c7-bc2c-4021-ae59-3ccd50ce438d req-fb771be3-489a-45fd-9102-6bc1f955cee3 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Refreshing network info cache for port 5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Start _get_guest_xml network_info=[{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:58:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Releasing lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance network_info: |[{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c1b4b71d-b692-4212-8eac-db1ea0759362 req-fdb1cd0f-5337-4c0a-a7a0-a2d17f3698e1 service nova] Acquired lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.network.neutron [req-c1b4b71d-b692-4212-8eac-db1ea0759362 req-fdb1cd0f-5337-4c0a-a7a0-a2d17f3698e1 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Refreshing network info cache for port c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Start _get_guest_xml network_info=[{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-8e99207c-901e-4c47-a11a-93ee42b02976 req-f02d388b-e704-40b8-a915-7c72fbe75caf service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-changed-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-8e99207c-901e-4c47-a11a-93ee42b02976 req-f02d388b-e704-40b8-a915-7c72fbe75caf service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Refreshing instance network info cache due to event network-changed-1d37f04c-d365-4720-ace0-73d2cdd79af2. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8e99207c-901e-4c47-a11a-93ee42b02976 req-f02d388b-e704-40b8-a915-7c72fbe75caf service nova] Acquiring lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8e99207c-901e-4c47-a11a-93ee42b02976 req-f02d388b-e704-40b8-a915-7c72fbe75caf service nova] Acquired lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.network.neutron [req-8e99207c-901e-4c47-a11a-93ee42b02976 req-f02d388b-e704-40b8-a915-7c72fbe75caf service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Refreshing network info cache for port 1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.network.neutron [req-397f13c7-bc2c-4021-ae59-3ccd50ce438d req-fb771be3-489a-45fd-9102-6bc1f955cee3 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updated VIF entry in instance network info cache for port 5f9f171c-75e5-4362-8075-9051f6fbcabe. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG nova.network.neutron [req-397f13c7-bc2c-4021-ae59-3ccd50ce438d req-fb771be3-489a-45fd-9102-6bc1f955cee3 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-397f13c7-bc2c-4021-ae59-3ccd50ce438d req-fb771be3-489a-45fd-9102-6bc1f955cee3 service nova] Releasing lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updated VIF entry in instance network info cache for port 39bff660-0a48-4f81-a38f-a10af4afd7f8. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:59:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updating instance_info_cache with network_info: [{"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b04ddde9-8177-4bd2-a9c3-06035748e28c req-352673b4-6d07-4c51-bd65-c6cc0109888b service nova] Releasing lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-8e99207c-901e-4c47-a11a-93ee42b02976 req-f02d388b-e704-40b8-a915-7c72fbe75caf service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updated VIF entry in instance network info cache for port 1d37f04c-d365-4720-ace0-73d2cdd79af2. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:59:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-8e99207c-901e-4c47-a11a-93ee42b02976 req-f02d388b-e704-40b8-a915-7c72fbe75caf service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updating instance_info_cache with network_info: [{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8e99207c-901e-4c47-a11a-93ee42b02976 req-f02d388b-e704-40b8-a915-7c72fbe75caf service nova] Releasing lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Successfully updated port: af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.compute.manager [req-c46b3f69-ad99-4584-a4e9-79a8c09bbc02 req-b30c4a67-6185-40ec-9acd-655d69c50272 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-changed-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.compute.manager [req-c46b3f69-ad99-4584-a4e9-79a8c09bbc02 req-b30c4a67-6185-40ec-9acd-655d69c50272 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Refreshing instance network info cache due to event network-changed-af72e448-83b0-4bec-8ead-79148cc4213c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c46b3f69-ad99-4584-a4e9-79a8c09bbc02 req-b30c4a67-6185-40ec-9acd-655d69c50272 service nova] Acquiring lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c46b3f69-ad99-4584-a4e9-79a8c09bbc02 req-b30c4a67-6185-40ec-9acd-655d69c50272 service nova] Acquired lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.network.neutron [req-c46b3f69-ad99-4584-a4e9-79a8c09bbc02 req-b30c4a67-6185-40ec-9acd-655d69c50272 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Refreshing network info cache for port af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.network.neutron [req-c46b3f69-ad99-4584-a4e9-79a8c09bbc02 req-b30c4a67-6185-40ec-9acd-655d69c50272 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.network.neutron [req-c1b4b71d-b692-4212-8eac-db1ea0759362 req-fdb1cd0f-5337-4c0a-a7a0-a2d17f3698e1 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updated VIF entry in instance network info cache for port c3d72fdf-8035-4c64-8514-366e8e6b2b51. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.network.neutron [req-c1b4b71d-b692-4212-8eac-db1ea0759362 req-fdb1cd0f-5337-4c0a-a7a0-a2d17f3698e1 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c1b4b71d-b692-4212-8eac-db1ea0759362 req-fdb1cd0f-5337-4c0a-a7a0-a2d17f3698e1 service nova] Releasing lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.compute.manager [req-1ce1fa1f-8774-4f4e-abcf-5a1124b5bae7 req-d7f017d0-2eb2-4ebd-ba90-11ebb4189bd7 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received event network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ce1fa1f-8774-4f4e-abcf-5a1124b5bae7 req-d7f017d0-2eb2-4ebd-ba90-11ebb4189bd7 service nova] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ce1fa1f-8774-4f4e-abcf-5a1124b5bae7 req-d7f017d0-2eb2-4ebd-ba90-11ebb4189bd7 service nova] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ce1fa1f-8774-4f4e-abcf-5a1124b5bae7 req-d7f017d0-2eb2-4ebd-ba90-11ebb4189bd7 service nova] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:03 user nova-compute[72178]: DEBUG nova.compute.manager [req-1ce1fa1f-8774-4f4e-abcf-5a1124b5bae7 req-d7f017d0-2eb2-4ebd-ba90-11ebb4189bd7 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] No waiting events found dispatching network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:03 user nova-compute[72178]: WARNING nova.compute.manager [req-1ce1fa1f-8774-4f4e-abcf-5a1124b5bae7 req-d7f017d0-2eb2-4ebd-ba90-11ebb4189bd7 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received unexpected event network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 for instance with vm_state building and task_state spawning.
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG nova.network.neutron [req-c46b3f69-ad99-4584-a4e9-79a8c09bbc02 req-b30c4a67-6185-40ec-9acd-655d69c50272 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c46b3f69-ad99-4584-a4e9-79a8c09bbc02 req-b30c4a67-6185-40ec-9acd-655d69c50272 service nova] Releasing lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquired lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-e9330191-2e0d-42d4-8a67-9a31f5aa2887 req-33a8f1a4-bdbf-4c93-9e79-9031a20724da service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received event network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e9330191-2e0d-42d4-8a67-9a31f5aa2887 req-33a8f1a4-bdbf-4c93-9e79-9031a20724da service nova] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e9330191-2e0d-42d4-8a67-9a31f5aa2887 req-33a8f1a4-bdbf-4c93-9e79-9031a20724da service nova] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e9330191-2e0d-42d4-8a67-9a31f5aa2887 req-33a8f1a4-bdbf-4c93-9e79-9031a20724da service nova] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-e9330191-2e0d-42d4-8a67-9a31f5aa2887 req-33a8f1a4-bdbf-4c93-9e79-9031a20724da service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] No waiting events found dispatching network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:04 user nova-compute[72178]: WARNING nova.compute.manager [req-e9330191-2e0d-42d4-8a67-9a31f5aa2887 req-33a8f1a4-bdbf-4c93-9e79-9031a20724da service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received unexpected event network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 for instance with vm_state building and task_state spawning.
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Releasing lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance network_info: |[{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Start _get_guest_xml network_info=[{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received event network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] No waiting events found dispatching network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:05 user nova-compute[72178]: WARNING nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received unexpected event network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 for instance with vm_state building and task_state spawning.
Aug 01 11:59:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] No waiting events found dispatching network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:05 user nova-compute[72178]: WARNING nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received unexpected event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 for instance with vm_state building and task_state spawning.
Aug 01 11:59:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] No waiting events found dispatching network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:06 user nova-compute[72178]: WARNING nova.compute.manager [req-ecf89f19-51f5-4ca7-95f7-afd0d6cc96bd req-ac07ab9d-3dc8-4ba9-880b-6bf409a88f10 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received unexpected event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 for instance with vm_state building and task_state spawning.
Aug 01 11:59:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-bbb2ed72-bf31-4e30-9a9b-eeba96d342bc req-d512c53c-560a-4ec4-b33b-c8a7adbd4384 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received event network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbb2ed72-bf31-4e30-9a9b-eeba96d342bc req-d512c53c-560a-4ec4-b33b-c8a7adbd4384 service nova] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbb2ed72-bf31-4e30-9a9b-eeba96d342bc req-d512c53c-560a-4ec4-b33b-c8a7adbd4384 service nova] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbb2ed72-bf31-4e30-9a9b-eeba96d342bc req-d512c53c-560a-4ec4-b33b-c8a7adbd4384 service nova] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-bbb2ed72-bf31-4e30-9a9b-eeba96d342bc req-d512c53c-560a-4ec4-b33b-c8a7adbd4384 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] No waiting events found dispatching network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:07 user nova-compute[72178]: WARNING nova.compute.manager [req-bbb2ed72-bf31-4e30-9a9b-eeba96d342bc req-d512c53c-560a-4ec4-b33b-c8a7adbd4384 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received unexpected event network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 for instance with vm_state building and task_state spawning.
Aug 01 11:59:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state building and task_state spawning.
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state building and task_state spawning.
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] No waiting events found dispatching network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received unexpected event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 for instance with vm_state building and task_state spawning.
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] No waiting events found dispatching network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.compute.manager [req-1c5eaa44-38ca-455d-8e90-0efd9c87fe05 req-97441d1f-f9f8-4daf-a6e9-45932086f9c8 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received unexpected event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 for instance with vm_state building and task_state spawning.
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.3178833, fc8d64a1-321c-45d7-9db3-1159c91ee9b7 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] VM Resumed (Lifecycle Event)
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:08 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Instance spawned successfully.
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.objects.instance [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'pci_devices' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:59:08 user nova-compute[72178]:   <uuid>f75a07e7-7cd8-4a63-b03d-422e07da25f8</uuid>
Aug 01 11:59:08 user nova-compute[72178]:   <name>instance-00000008</name>
Aug 01 11:59:08 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:59:08 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:59:08 user nova-compute[72178]:   <metadata>
Aug 01 11:59:08 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:59:08 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:name>tempest-ServerActionsTestOtherB-server-1304452031</nova:name>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:59:08</nova:creationTime>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:59:08 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:owner>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:user uuid="57295306c0f44b0db27c9eb0c3ac8b6b">tempest-ServerActionsTestOtherB-2113691896-project-member</nova:user>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:project uuid="b58e90c2bb974b6a9be977ac0ce46828">tempest-ServerActionsTestOtherB-2113691896</nova:project>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:owner>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:ports>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:port uuid="5f9f171c-75e5-4362-8075-9051f6fbcabe">
Aug 01 11:59:08 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 11:59:08 user nova-compute[72178]:         </nova:port>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:ports>
Aug 01 11:59:08 user nova-compute[72178]:     </nova:instance>
Aug 01 11:59:08 user nova-compute[72178]:   </metadata>
Aug 01 11:59:08 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:59:08 user nova-compute[72178]:     <system>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="serial">f75a07e7-7cd8-4a63-b03d-422e07da25f8</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="uuid">f75a07e7-7cd8-4a63-b03d-422e07da25f8</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:59:08 user nova-compute[72178]:     </system>
Aug 01 11:59:08 user nova-compute[72178]:   </sysinfo>
Aug 01 11:59:08 user nova-compute[72178]:   <os>
Aug 01 11:59:08 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:59:08 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:59:08 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:59:08 user nova-compute[72178]:   </os>
Aug 01 11:59:08 user nova-compute[72178]:   <features>
Aug 01 11:59:08 user nova-compute[72178]:     <acpi/>
Aug 01 11:59:08 user nova-compute[72178]:     <apic/>
Aug 01 11:59:08 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:59:08 user nova-compute[72178]:   </features>
Aug 01 11:59:08 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:59:08 user nova-compute[72178]:   </clock>
Aug 01 11:59:08 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:59:08 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:59:08 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:59:08 user nova-compute[72178]:   </cpu>
Aug 01 11:59:08 user nova-compute[72178]:   <devices>
Aug 01 11:59:08 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:59:08 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:59:08 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk"/>
Aug 01 11:59:08 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:     </disk>
Aug 01 11:59:08 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:59:08 user nova-compute[72178]:       <mac address="fa:16:3e:3b:c9:93"/>
Aug 01 11:59:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:59:08 user nova-compute[72178]:       <target dev="tap5f9f171c-75"/>
Aug 01 11:59:08 user nova-compute[72178]:     </interface>
Aug 01 11:59:08 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:59:08 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/console.log" append="off"/>
Aug 01 11:59:08 user nova-compute[72178]:     </serial>
Aug 01 11:59:08 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:59:08 user nova-compute[72178]:     <video>
Aug 01 11:59:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:     </video>
Aug 01 11:59:08 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:59:08 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:59:08 user nova-compute[72178]:     </rng>
Aug 01 11:59:08 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:59:08 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:59:08 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:59:08 user nova-compute[72178]:     </memballoon>
Aug 01 11:59:08 user nova-compute[72178]:   </devices>
Aug 01 11:59:08 user nova-compute[72178]: </domain>
Aug 01 11:59:08 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG os_vif [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:59:08 user nova-compute[72178]: INFO nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Took 17.95 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1036967952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1036967952',id=1,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/k0AF0iCovyXTACa5eh3dd6pxRNW/SUFtSHtOjmemB5IfF7kyYOtdWAYj/Gd497SIk8ZXd8uhZGLK6NnghFD57HW695kxmzHbA12mCcmXuNymqYCZmag/37hQCZWCzcA==',key_name='tempest-keypair-644047153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-n6me8y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=a378bfa5-d230-4e81-bc4f-16132501f1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'pci_devices' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9f171c-75, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f9f171c-75, col_values=(('external_ids', {'iface-id': '5f9f171c-75e5-4362-8075-9051f6fbcabe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:c9:93', 'vm-uuid': 'f75a07e7-7cd8-4a63-b03d-422e07da25f8'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1310442517',display_name='tempest-ServerStableDeviceRescueTest-server-1310442517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1310442517',id=7,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsBmHVnO/9EUTsKC74RMmVO5u+R3m1s7kZbSPz1nI6lkEfrYK4U04WdlnuQWv7muLheKRhVUhUIGufzpGOsl6lv4anSTSZ1rccfsHs4SgBPjx6GjZKQbeEO3plhLWQDiQ==',key_name='tempest-keypair-769995709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cafcb07520f4031a1902defc1d5a5e0',ramdisk_id='',reservation_id='r-k2jg8hq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-970062569',owner_user_name='tempest-ServerStableDeviceRescueTest-970062569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='822801b8c40b40b1a49fbdd859575f1a',uuid=96c961db-b50d-45c9-bc4f-0c594b5a6c2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Converting VIF {"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:b8:ea,bridge_name='br-int',has_traffic_filtering=True,id=af72e448-83b0-4bec-8ead-79148cc4213c,network=Network(1d9d7786-4cab-410a-a318-cb21f3870443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf72e448-83') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:59:08 user nova-compute[72178]:   <uuid>a378bfa5-d230-4e81-bc4f-16132501f1df</uuid>
Aug 01 11:59:08 user nova-compute[72178]:   <name>instance-00000001</name>
Aug 01 11:59:08 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:59:08 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:59:08 user nova-compute[72178]:   <metadata>
Aug 01 11:59:08 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:59:08 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1036967952</nova:name>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:59:08</nova:creationTime>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:59:08 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:owner>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:user uuid="435396a1a5f54338a2af729f1e3f1754">tempest-AttachVolumeShelveTestJSON-210279899-project-member</nova:user>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:project uuid="41cc7b29110b4871a9b5c6e0328bdd28">tempest-AttachVolumeShelveTestJSON-210279899</nova:project>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:owner>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:ports>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:port uuid="c3d72fdf-8035-4c64-8514-366e8e6b2b51">
Aug 01 11:59:08 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 11:59:08 user nova-compute[72178]:         </nova:port>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:ports>
Aug 01 11:59:08 user nova-compute[72178]:     </nova:instance>
Aug 01 11:59:08 user nova-compute[72178]:   </metadata>
Aug 01 11:59:08 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:59:08 user nova-compute[72178]:     <system>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="serial">a378bfa5-d230-4e81-bc4f-16132501f1df</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="uuid">a378bfa5-d230-4e81-bc4f-16132501f1df</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:59:08 user nova-compute[72178]:     </system>
Aug 01 11:59:08 user nova-compute[72178]:   </sysinfo>
Aug 01 11:59:08 user nova-compute[72178]:   <os>
Aug 01 11:59:08 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:59:08 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:59:08 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:59:08 user nova-compute[72178]:   </os>
Aug 01 11:59:08 user nova-compute[72178]:   <features>
Aug 01 11:59:08 user nova-compute[72178]:     <acpi/>
Aug 01 11:59:08 user nova-compute[72178]:     <apic/>
Aug 01 11:59:08 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:59:08 user nova-compute[72178]:   </features>
Aug 01 11:59:08 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:59:08 user nova-compute[72178]:   </clock>
Aug 01 11:59:08 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:59:08 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:59:08 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:59:08 user nova-compute[72178]:   </cpu>
Aug 01 11:59:08 user nova-compute[72178]:   <devices>
Aug 01 11:59:08 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:59:08 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:59:08 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk"/>
Aug 01 11:59:08 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:     </disk>
Aug 01 11:59:08 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:59:08 user nova-compute[72178]:       <mac address="fa:16:3e:79:57:f2"/>
Aug 01 11:59:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:59:08 user nova-compute[72178]:       <target dev="tapc3d72fdf-80"/>
Aug 01 11:59:08 user nova-compute[72178]:     </interface>
Aug 01 11:59:08 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:59:08 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/console.log" append="off"/>
Aug 01 11:59:08 user nova-compute[72178]:     </serial>
Aug 01 11:59:08 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:59:08 user nova-compute[72178]:     <video>
Aug 01 11:59:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:     </video>
Aug 01 11:59:08 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:59:08 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:59:08 user nova-compute[72178]:     </rng>
Aug 01 11:59:08 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:59:08 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:59:08 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:59:08 user nova-compute[72178]:     </memballoon>
Aug 01 11:59:08 user nova-compute[72178]:   </devices>
Aug 01 11:59:08 user nova-compute[72178]: </domain>
Aug 01 11:59:08 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1036967952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1036967952',id=1,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/k0AF0iCovyXTACa5eh3dd6pxRNW/SUFtSHtOjmemB5IfF7kyYOtdWAYj/Gd497SIk8ZXd8uhZGLK6NnghFD57HW695kxmzHbA12mCcmXuNymqYCZmag/37hQCZWCzcA==',key_name='tempest-keypair-644047153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-n6me8y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=a378bfa5-d230-4e81-bc4f-16132501f1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG os_vif [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:59:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.3255503, fc8d64a1-321c-45d7-9db3-1159c91ee9b7 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] VM Started (Lifecycle Event)
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:59:08 user nova-compute[72178]:   <uuid>96c961db-b50d-45c9-bc4f-0c594b5a6c2d</uuid>
Aug 01 11:59:08 user nova-compute[72178]:   <name>instance-00000007</name>
Aug 01 11:59:08 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:59:08 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:59:08 user nova-compute[72178]:   <metadata>
Aug 01 11:59:08 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:59:08 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1310442517</nova:name>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:59:08</nova:creationTime>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:59:08 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:owner>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:user uuid="822801b8c40b40b1a49fbdd859575f1a">tempest-ServerStableDeviceRescueTest-970062569-project-member</nova:user>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:project uuid="8cafcb07520f4031a1902defc1d5a5e0">tempest-ServerStableDeviceRescueTest-970062569</nova:project>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:owner>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:59:08 user nova-compute[72178]:       <nova:ports>
Aug 01 11:59:08 user nova-compute[72178]:         <nova:port uuid="af72e448-83b0-4bec-8ead-79148cc4213c">
Aug 01 11:59:08 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 11:59:08 user nova-compute[72178]:         </nova:port>
Aug 01 11:59:08 user nova-compute[72178]:       </nova:ports>
Aug 01 11:59:08 user nova-compute[72178]:     </nova:instance>
Aug 01 11:59:08 user nova-compute[72178]:   </metadata>
Aug 01 11:59:08 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:59:08 user nova-compute[72178]:     <system>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="serial">96c961db-b50d-45c9-bc4f-0c594b5a6c2d</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="uuid">96c961db-b50d-45c9-bc4f-0c594b5a6c2d</entry>
Aug 01 11:59:08 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:59:08 user nova-compute[72178]:     </system>
Aug 01 11:59:08 user nova-compute[72178]:   </sysinfo>
Aug 01 11:59:08 user nova-compute[72178]:   <os>
Aug 01 11:59:08 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:59:08 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:59:08 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:59:08 user nova-compute[72178]:   </os>
Aug 01 11:59:08 user nova-compute[72178]:   <features>
Aug 01 11:59:08 user nova-compute[72178]:     <acpi/>
Aug 01 11:59:08 user nova-compute[72178]:     <apic/>
Aug 01 11:59:08 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:59:08 user nova-compute[72178]:   </features>
Aug 01 11:59:08 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:59:08 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:59:08 user nova-compute[72178]:   </clock>
Aug 01 11:59:08 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:59:08 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:59:08 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:59:08 user nova-compute[72178]:   </cpu>
Aug 01 11:59:08 user nova-compute[72178]:   <devices>
Aug 01 11:59:08 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:59:08 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:59:08 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk"/>
Aug 01 11:59:08 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:     </disk>
Aug 01 11:59:08 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:59:08 user nova-compute[72178]:       <mac address="fa:16:3e:01:b8:ea"/>
Aug 01 11:59:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:59:08 user nova-compute[72178]:       <target dev="tapaf72e448-83"/>
Aug 01 11:59:08 user nova-compute[72178]:     </interface>
Aug 01 11:59:08 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:59:08 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/console.log" append="off"/>
Aug 01 11:59:08 user nova-compute[72178]:     </serial>
Aug 01 11:59:08 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:59:08 user nova-compute[72178]:     <video>
Aug 01 11:59:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:08 user nova-compute[72178]:     </video>
Aug 01 11:59:08 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:59:08 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:59:08 user nova-compute[72178]:     </rng>
Aug 01 11:59:08 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:59:08 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:59:08 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:59:08 user nova-compute[72178]:     </memballoon>
Aug 01 11:59:08 user nova-compute[72178]:   </devices>
Aug 01 11:59:08 user nova-compute[72178]: </domain>
Aug 01 11:59:08 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1310442517',display_name='tempest-ServerStableDeviceRescueTest-server-1310442517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1310442517',id=7,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsBmHVnO/9EUTsKC74RMmVO5u+R3m1s7kZbSPz1nI6lkEfrYK4U04WdlnuQWv7muLheKRhVUhUIGufzpGOsl6lv4anSTSZ1rccfsHs4SgBPjx6GjZKQbeEO3plhLWQDiQ==',key_name='tempest-keypair-769995709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8cafcb07520f4031a1902defc1d5a5e0',ramdisk_id='',reservation_id='r-k2jg8hq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-970062569',owner_user_name='tempest-ServerStableDeviceRescueTest-970062569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:58:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='822801b8c40b40b1a49fbdd859575f1a',uuid=96c961db-b50d-45c9-bc4f-0c594b5a6c2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Converting VIF {"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:b8:ea,bridge_name='br-int',has_traffic_filtering=True,id=af72e448-83b0-4bec-8ead-79148cc4213c,network=Network(1d9d7786-4cab-410a-a318-cb21f3870443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf72e448-83') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG os_vif [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:b8:ea,bridge_name='br-int',has_traffic_filtering=True,id=af72e448-83b0-4bec-8ead-79148cc4213c,network=Network(1d9d7786-4cab-410a-a318-cb21f3870443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf72e448-83') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:59:08 user nova-compute[72178]: INFO os_vif [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75')
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf72e448-83, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf72e448-83, col_values=(('external_ids', {'iface-id': 'af72e448-83b0-4bec-8ead-79148cc4213c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:b8:ea', 'vm-uuid': '96c961db-b50d-45c9-bc4f-0c594b5a6c2d'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Instance spawned successfully.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d72fdf-80, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3d72fdf-80, col_values=(('external_ids', {'iface-id': 'c3d72fdf-8035-4c64-8514-366e8e6b2b51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:57:f2', 'vm-uuid': 'a378bfa5-d230-4e81-bc4f-16132501f1df'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:09 user nova-compute[72178]: INFO os_vif [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:b8:ea,bridge_name='br-int',has_traffic_filtering=True,id=af72e448-83b0-4bec-8ead-79148cc4213c,network=Network(1d9d7786-4cab-410a-a318-cb21f3870443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf72e448-83')
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance spawned successfully.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Instance spawned successfully.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:09 user nova-compute[72178]: INFO os_vif [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80')
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance spawned successfully.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.485689, 5f720460-477f-472a-904b-7a8c82bca76e => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] VM Resumed (Lifecycle Event)
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No VIF found with MAC fa:16:3e:01:b8:ea, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.4859707, 5f720460-477f-472a-904b-7a8c82bca76e => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] VM Started (Lifecycle Event)
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] No VIF found with MAC fa:16:3e:3b:c9:93, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Took 20.31 seconds to build instance.
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Took 18.08 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Took 18.69 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Took 19.73 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.525915, 8ac32412-1f05-4d62-a184-0b90f1b3d21c => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] VM Resumed (Lifecycle Event)
Aug 01 11:59:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e820a58-c6d7-433a-9fbd-aa76db2a7a35 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.677s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No VIF found with MAC fa:16:3e:79:57:f2, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:59:09 user nova-compute[72178]: INFO nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Took 20.19 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.529558, 8ac32412-1f05-4d62-a184-0b90f1b3d21c => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] VM Started (Lifecycle Event)
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Took 19.97 seconds to build instance.
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Took 21.71 seconds to build instance.
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Took 20.83 seconds to build instance.
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Took 22.45 seconds to build instance.
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c4afee00-1436-4de4-bedb-3a8acf0214a0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "5f720460-477f-472a-904b-7a8c82bca76e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.151s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e6d0f6a7-22de-4c7f-b57e-5e69d93fc89a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.066s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0a6a3f2-7528-4410-b303-d25cb8226464 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.796s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c685cc1f-a326-4945-9368-71638acadcf6 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.067s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.7383463, 326f0759-29ce-4441-ba2a-7a74d8726eb7 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] VM Resumed (Lifecycle Event)
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.738666, 326f0759-29ce-4441-ba2a-7a74d8726eb7 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] VM Started (Lifecycle Event)
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.7388349, 84869969-6058-4000-808e-7ccb4ea10aa9 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] VM Resumed (Lifecycle Event)
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891148.7389336, 84869969-6058-4000-808e-7ccb4ea10aa9 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:10 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] VM Started (Lifecycle Event)
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-8dede3c4-7448-4f5b-a9fc-1b8b54e98b97 req-8a438f46-00ad-4e7b-8f4f-8621fc812954 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8dede3c4-7448-4f5b-a9fc-1b8b54e98b97 req-8a438f46-00ad-4e7b-8f4f-8621fc812954 service nova] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8dede3c4-7448-4f5b-a9fc-1b8b54e98b97 req-8a438f46-00ad-4e7b-8f4f-8621fc812954 service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8dede3c4-7448-4f5b-a9fc-1b8b54e98b97 req-8a438f46-00ad-4e7b-8f4f-8621fc812954 service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-8dede3c4-7448-4f5b-a9fc-1b8b54e98b97 req-8a438f46-00ad-4e7b-8f4f-8621fc812954 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] No waiting events found dispatching network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:15 user nova-compute[72178]: WARNING nova.compute.manager [req-8dede3c4-7448-4f5b-a9fc-1b8b54e98b97 req-8a438f46-00ad-4e7b-8f4f-8621fc812954 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received unexpected event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 for instance with vm_state building and task_state spawning.
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-e0fd6e07-bf2a-421b-9d44-0d6e3df12c1e req-934011d8-6455-4a0e-8648-f624b5771c53 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0fd6e07-bf2a-421b-9d44-0d6e3df12c1e req-934011d8-6455-4a0e-8648-f624b5771c53 service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0fd6e07-bf2a-421b-9d44-0d6e3df12c1e req-934011d8-6455-4a0e-8648-f624b5771c53 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0fd6e07-bf2a-421b-9d44-0d6e3df12c1e req-934011d8-6455-4a0e-8648-f624b5771c53 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-e0fd6e07-bf2a-421b-9d44-0d6e3df12c1e req-934011d8-6455-4a0e-8648-f624b5771c53 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:16 user nova-compute[72178]: WARNING nova.compute.manager [req-e0fd6e07-bf2a-421b-9d44-0d6e3df12c1e req-934011d8-6455-4a0e-8648-f624b5771c53 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state building and task_state spawning.
Aug 01 11:59:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:59:17 user nova-compute[72178]: INFO nova.compute.claims [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Claim successful on node user
Aug 01 11:59:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] No waiting events found dispatching network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:17 user nova-compute[72178]: WARNING nova.compute.manager [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received unexpected event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 for instance with vm_state building and task_state spawning.
Aug 01 11:59:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:17 user nova-compute[72178]: WARNING nova.compute.manager [req-3e4b725f-3c10-486a-8bd3-c731865ce94d req-ca71551f-1d0d-438e-add1-4e692d9e8c4e service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state building and task_state spawning.
Aug 01 11:59:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.912s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-819d655e-6963-403e-8e28-a67bc70dd890 req-b792db18-545b-4e07-84a1-3d5909aaefdc service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-819d655e-6963-403e-8e28-a67bc70dd890 req-b792db18-545b-4e07-84a1-3d5909aaefdc service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-819d655e-6963-403e-8e28-a67bc70dd890 req-b792db18-545b-4e07-84a1-3d5909aaefdc service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-819d655e-6963-403e-8e28-a67bc70dd890 req-b792db18-545b-4e07-84a1-3d5909aaefdc service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-819d655e-6963-403e-8e28-a67bc70dd890 req-b792db18-545b-4e07-84a1-3d5909aaefdc service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:18 user nova-compute[72178]: WARNING nova.compute.manager [req-819d655e-6963-403e-8e28-a67bc70dd890 req-b792db18-545b-4e07-84a1-3d5909aaefdc service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state building and task_state spawning.
Aug 01 11:59:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:59:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:59:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:59:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.policy [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6bcb5e39f04635abbc68fcddfcf8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cb02845ea40aea6b64cabe1f600c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:59:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Creating image(s)
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "/opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "/opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "/opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.275s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891159.521438, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:19 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Resumed (Lifecycle Event)
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance spawned successfully.
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.263s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-97c747e7-79d2-4af8-9ef2-9e00981b7fb8 req-c10a0d43-0501-4f5b-93ba-d96b98fa470b service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-97c747e7-79d2-4af8-9ef2-9e00981b7fb8 req-c10a0d43-0501-4f5b-93ba-d96b98fa470b service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-97c747e7-79d2-4af8-9ef2-9e00981b7fb8 req-c10a0d43-0501-4f5b-93ba-d96b98fa470b service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-97c747e7-79d2-4af8-9ef2-9e00981b7fb8 req-c10a0d43-0501-4f5b-93ba-d96b98fa470b service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-97c747e7-79d2-4af8-9ef2-9e00981b7fb8 req-c10a0d43-0501-4f5b-93ba-d96b98fa470b service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:19 user nova-compute[72178]: WARNING nova.compute.manager [req-97c747e7-79d2-4af8-9ef2-9e00981b7fb8 req-c10a0d43-0501-4f5b-93ba-d96b98fa470b service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state building and task_state spawning.
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk 1073741824" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.404s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:19 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891159.5217826, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:19 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Started (Lifecycle Event)
Aug 01 11:59:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance spawned successfully.
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance spawned successfully.
Aug 01 11:59:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891159.7893317, a378bfa5-d230-4e81-bc4f-16132501f1df => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] VM Resumed (Lifecycle Event)
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.304s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Took 27.09 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891159.790338, a378bfa5-d230-4e81-bc4f-16132501f1df => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] VM Started (Lifecycle Event)
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Took 31.63 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Took 26.32 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891159.7904706, 96c961db-b50d-45c9-bc4f-0c594b5a6c2d => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] VM Resumed (Lifecycle Event)
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.399s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Cannot resize image /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'migration_context' on Instance uuid 686d22d8-fae6-4035-aeac-c80cbeaff08b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Took 28.26 seconds to build instance.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Ensure instance console log exists: /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2e67997b-bd19-4d75-b27c-fe345590a603 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.558s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Took 28.87 seconds to build instance.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891159.7906024, 96c961db-b50d-45c9-bc4f-0c594b5a6c2d => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] VM Started (Lifecycle Event)
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9b50f16e-0001-4fdd-b6bf-5f1f6564fb6a tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.065s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:20 user nova-compute[72178]: INFO nova.compute.manager [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Took 33.31 seconds to build instance.
Aug 01 11:59:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4394c5af-f8c5-4b68-8fbf-33a4266949bf tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.527s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 11:59:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] There are 0 instances to clean {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 11:59:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=72178) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 11:59:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:21 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Successfully created port: 97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:59:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:22 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:59:23 user nova-compute[72178]: INFO nova.compute.claims [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Claim successful on node user
Aug 01 11:59:23 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Successfully updated port: 97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquired lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG nova.compute.manager [req-fc9c876b-c1ea-4cb4-9c36-0e54e903e93e req-b55e36b8-e62b-44de-824e-096195519d23 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received event network-changed-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG nova.compute.manager [req-fc9c876b-c1ea-4cb4-9c36-0e54e903e93e req-b55e36b8-e62b-44de-824e-096195519d23 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Refreshing instance network info cache due to event network-changed-97b9bcbd-4448-4211-a3df-f3e08a41f14e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fc9c876b-c1ea-4cb4-9c36-0e54e903e93e req-b55e36b8-e62b-44de-824e-096195519d23 service nova] Acquiring lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Updating instance_info_cache with network_info: [{"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Releasing lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Instance network_info: |[{"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fc9c876b-c1ea-4cb4-9c36-0e54e903e93e req-b55e36b8-e62b-44de-824e-096195519d23 service nova] Acquired lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.network.neutron [req-fc9c876b-c1ea-4cb4-9c36-0e54e903e93e req-b55e36b8-e62b-44de-824e-096195519d23 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Refreshing network info cache for port 97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Start _get_guest_xml network_info=[{"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.478s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.244s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:24 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:24 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 11:59:24 user nova-compute[72178]: INFO nova.compute.claims [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Claim successful on node user
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1609867349',display_name='tempest-VolumesAdminNegativeTest-server-1609867349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1609867349',id=9,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgliz1YtqKtyQZHs1ti6i/RMoqx3mKNW2JtKnNjUUB9AX0oaVbXcWL/JDkqzMkDOHgLfSvlbDTYOa1BRjsokhoIgHouQCP3JcB9kcguuVnN9iqrqe03VA4fmJs7Ezl79g==',key_name='tempest-keypair-581068206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='966cb02845ea40aea6b64cabe1f600c2',ramdisk_id='',reservation_id='r-zyhqzvo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1802258801',owner_user_name='tempest-VolumesAdminNegativeTest-1802258801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6bcb5e39f04635abbc68fcddfcf8d1',uuid=686d22d8-fae6-4035-aeac-c80cbeaff08b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converting VIF {"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:12,bridge_name='br-int',has_traffic_filtering=True,id=97b9bcbd-4448-4211-a3df-f3e08a41f14e,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b9bcbd-44') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'pci_devices' on Instance uuid 686d22d8-fae6-4035-aeac-c80cbeaff08b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:59:24 user nova-compute[72178]:   <uuid>686d22d8-fae6-4035-aeac-c80cbeaff08b</uuid>
Aug 01 11:59:24 user nova-compute[72178]:   <name>instance-00000009</name>
Aug 01 11:59:24 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:59:24 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:59:24 user nova-compute[72178]:   <metadata>
Aug 01 11:59:24 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:59:24 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:59:24 user nova-compute[72178]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1609867349</nova:name>
Aug 01 11:59:24 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:59:24</nova:creationTime>
Aug 01 11:59:24 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:59:24 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:59:24 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:59:24 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:59:24 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:59:24 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:59:24 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:59:24 user nova-compute[72178]:       <nova:owner>
Aug 01 11:59:24 user nova-compute[72178]:         <nova:user uuid="fc6bcb5e39f04635abbc68fcddfcf8d1">tempest-VolumesAdminNegativeTest-1802258801-project-member</nova:user>
Aug 01 11:59:24 user nova-compute[72178]:         <nova:project uuid="966cb02845ea40aea6b64cabe1f600c2">tempest-VolumesAdminNegativeTest-1802258801</nova:project>
Aug 01 11:59:24 user nova-compute[72178]:       </nova:owner>
Aug 01 11:59:24 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:59:24 user nova-compute[72178]:       <nova:ports>
Aug 01 11:59:24 user nova-compute[72178]:         <nova:port uuid="97b9bcbd-4448-4211-a3df-f3e08a41f14e">
Aug 01 11:59:24 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 11:59:24 user nova-compute[72178]:         </nova:port>
Aug 01 11:59:24 user nova-compute[72178]:       </nova:ports>
Aug 01 11:59:24 user nova-compute[72178]:     </nova:instance>
Aug 01 11:59:24 user nova-compute[72178]:   </metadata>
Aug 01 11:59:24 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:59:24 user nova-compute[72178]:     <system>
Aug 01 11:59:24 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:59:24 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:59:24 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:59:24 user nova-compute[72178]:       <entry name="serial">686d22d8-fae6-4035-aeac-c80cbeaff08b</entry>
Aug 01 11:59:24 user nova-compute[72178]:       <entry name="uuid">686d22d8-fae6-4035-aeac-c80cbeaff08b</entry>
Aug 01 11:59:24 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:59:24 user nova-compute[72178]:     </system>
Aug 01 11:59:24 user nova-compute[72178]:   </sysinfo>
Aug 01 11:59:24 user nova-compute[72178]:   <os>
Aug 01 11:59:24 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:59:24 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:59:24 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:59:24 user nova-compute[72178]:   </os>
Aug 01 11:59:24 user nova-compute[72178]:   <features>
Aug 01 11:59:24 user nova-compute[72178]:     <acpi/>
Aug 01 11:59:24 user nova-compute[72178]:     <apic/>
Aug 01 11:59:24 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:59:24 user nova-compute[72178]:   </features>
Aug 01 11:59:24 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:59:24 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:59:24 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:59:24 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:59:24 user nova-compute[72178]:   </clock>
Aug 01 11:59:24 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:59:24 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:59:24 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:59:24 user nova-compute[72178]:   </cpu>
Aug 01 11:59:24 user nova-compute[72178]:   <devices>
Aug 01 11:59:24 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:59:24 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:59:24 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk"/>
Aug 01 11:59:24 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:59:24 user nova-compute[72178]:     </disk>
Aug 01 11:59:24 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:59:24 user nova-compute[72178]:       <mac address="fa:16:3e:66:64:12"/>
Aug 01 11:59:24 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:24 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:59:24 user nova-compute[72178]:       <target dev="tap97b9bcbd-44"/>
Aug 01 11:59:24 user nova-compute[72178]:     </interface>
Aug 01 11:59:24 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:59:24 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/console.log" append="off"/>
Aug 01 11:59:24 user nova-compute[72178]:     </serial>
Aug 01 11:59:24 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:59:24 user nova-compute[72178]:     <video>
Aug 01 11:59:24 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:24 user nova-compute[72178]:     </video>
Aug 01 11:59:24 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:59:24 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:59:24 user nova-compute[72178]:     </rng>
Aug 01 11:59:24 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:59:24 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:59:24 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:59:24 user nova-compute[72178]:     </memballoon>
Aug 01 11:59:24 user nova-compute[72178]:   </devices>
Aug 01 11:59:24 user nova-compute[72178]: </domain>
Aug 01 11:59:24 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1609867349',display_name='tempest-VolumesAdminNegativeTest-server-1609867349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1609867349',id=9,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgliz1YtqKtyQZHs1ti6i/RMoqx3mKNW2JtKnNjUUB9AX0oaVbXcWL/JDkqzMkDOHgLfSvlbDTYOa1BRjsokhoIgHouQCP3JcB9kcguuVnN9iqrqe03VA4fmJs7Ezl79g==',key_name='tempest-keypair-581068206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='966cb02845ea40aea6b64cabe1f600c2',ramdisk_id='',reservation_id='r-zyhqzvo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1802258801',owner_user_name='tempest-VolumesAdminNegativeTest-1802258801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:59:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6bcb5e39f04635abbc68fcddfcf8d1',uuid=686d22d8-fae6-4035-aeac-c80cbeaff08b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converting VIF {"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:12,bridge_name='br-int',has_traffic_filtering=True,id=97b9bcbd-4448-4211-a3df-f3e08a41f14e,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b9bcbd-44') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG os_vif [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:12,bridge_name='br-int',has_traffic_filtering=True,id=97b9bcbd-4448-4211-a3df-f3e08a41f14e,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b9bcbd-44') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97b9bcbd-44, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap97b9bcbd-44, col_values=(('external_ids', {'iface-id': '97b9bcbd-4448-4211-a3df-f3e08a41f14e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:64:12', 'vm-uuid': '686d22d8-fae6-4035-aeac-c80cbeaff08b'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:59:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:24 user nova-compute[72178]: INFO os_vif [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:64:12,bridge_name='br-int',has_traffic_filtering=True,id=97b9bcbd-4448-4211-a3df-f3e08a41f14e,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b9bcbd-44')
Aug 01 11:59:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 11:59:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] No VIF found with MAC fa:16:3e:66:64:12, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:59:25 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Creating image(s)
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "/opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "/opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG nova.policy [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80bcc4418bcd41ed8e58266cfd63d5c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7e5bd7c2af34f1895644736ec2be7ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.231s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.246s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk 1073741824" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.398s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.375s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.560s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.242s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 11:59:26 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.policy [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e3c0d10106a430c965b3c3f86d473f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5de9ff3ea9745a198b1148bba97015b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json" returned: 0 in 0.513s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Cannot resize image /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lazy-loading 'migration_context' on Instance uuid ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Ensure instance console log exists: /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.network.neutron [req-fc9c876b-c1ea-4cb4-9c36-0e54e903e93e req-b55e36b8-e62b-44de-824e-096195519d23 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Updated VIF entry in instance network info cache for port 97b9bcbd-4448-4211-a3df-f3e08a41f14e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG nova.network.neutron [req-fc9c876b-c1ea-4cb4-9c36-0e54e903e93e req-b55e36b8-e62b-44de-824e-096195519d23 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Updating instance_info_cache with network_info: [{"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fc9c876b-c1ea-4cb4-9c36-0e54e903e93e req-b55e36b8-e62b-44de-824e-096195519d23 service nova] Releasing lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 11:59:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Creating image(s)
Aug 01 11:59:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "/opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "/opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "/opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "d8d590ea56dd6150010efc4cbac746d986f21c1d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "d8d590ea56dd6150010efc4cbac746d986f21c1d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-9cae7e23-4f35-429c-a8df-de5646441a65 req-edda3601-8530-421e-8028-96feeb8a8f3b service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received event network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cae7e23-4f35-429c-a8df-de5646441a65 req-edda3601-8530-421e-8028-96feeb8a8f3b service nova] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cae7e23-4f35-429c-a8df-de5646441a65 req-edda3601-8530-421e-8028-96feeb8a8f3b service nova] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cae7e23-4f35-429c-a8df-de5646441a65 req-edda3601-8530-421e-8028-96feeb8a8f3b service nova] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-9cae7e23-4f35-429c-a8df-de5646441a65 req-edda3601-8530-421e-8028-96feeb8a8f3b service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] No waiting events found dispatching network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:27 user nova-compute[72178]: WARNING nova.compute.manager [req-9cae7e23-4f35-429c-a8df-de5646441a65 req-edda3601-8530-421e-8028-96feeb8a8f3b service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received unexpected event network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e for instance with vm_state building and task_state spawning.
Aug 01 11:59:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Successfully created port: ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:59:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Successfully created port: cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d.part --force-share --output=json" returned: 0 in 0.303s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG nova.virt.images [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] 87df66e6-21ec-470e-af46-e832c5aad99a was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d.part /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-e5041295-051a-4256-b6db-f1960d50b657 req-ce553043-def5-42b8-9854-e6b7a86ace9f service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received event network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e5041295-051a-4256-b6db-f1960d50b657 req-ce553043-def5-42b8-9854-e6b7a86ace9f service nova] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e5041295-051a-4256-b6db-f1960d50b657 req-ce553043-def5-42b8-9854-e6b7a86ace9f service nova] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e5041295-051a-4256-b6db-f1960d50b657 req-ce553043-def5-42b8-9854-e6b7a86ace9f service nova] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-e5041295-051a-4256-b6db-f1960d50b657 req-ce553043-def5-42b8-9854-e6b7a86ace9f service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] No waiting events found dispatching network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:29 user nova-compute[72178]: WARNING nova.compute.manager [req-e5041295-051a-4256-b6db-f1960d50b657 req-ce553043-def5-42b8-9854-e6b7a86ace9f service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received unexpected event network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e for instance with vm_state building and task_state spawning.
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d.part /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d.converted" returned: 0 in 0.603s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d.converted --force-share --output=json" returned: 0 in 0.335s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "d8d590ea56dd6150010efc4cbac746d986f21c1d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.951s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Successfully updated port: ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquired lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-3d36899c-2fcd-4044-af87-82ef60b44f28 req-752de733-987c-4c1b-b45f-c2cf1e96ef97 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received event network-changed-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-3d36899c-2fcd-4044-af87-82ef60b44f28 req-752de733-987c-4c1b-b45f-c2cf1e96ef97 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Refreshing instance network info cache due to event network-changed-ce5af459-034f-4974-8020-e351fea55ce2. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d36899c-2fcd-4044-af87-82ef60b44f28 req-752de733-987c-4c1b-b45f-c2cf1e96ef97 service nova] Acquiring lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d --force-share --output=json" returned: 0 in 0.186s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "d8d590ea56dd6150010efc4cbac746d986f21c1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "d8d590ea56dd6150010efc4cbac746d986f21c1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d --force-share --output=json" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d,backing_fmt=raw /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d,backing_fmt=raw /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk 1073741824" returned: 0 in 0.286s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "d8d590ea56dd6150010efc4cbac746d986f21c1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.467s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d --force-share --output=json" returned: 0 in 0.282s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Checking if we can resize image /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 11:59:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Updating instance_info_cache with network_info: [{"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Cannot resize image /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lazy-loading 'migration_context' on Instance uuid 249a69cd-ce20-4613-862d-ec31fa6669e5 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Releasing lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Instance network_info: |[{"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Successfully updated port: cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d36899c-2fcd-4044-af87-82ef60b44f28 req-752de733-987c-4c1b-b45f-c2cf1e96ef97 service nova] Acquired lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d36899c-2fcd-4044-af87-82ef60b44f28 req-752de733-987c-4c1b-b45f-c2cf1e96ef97 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Refreshing network info cache for port ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Start _get_guest_xml network_info=[{"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Ensure instance console log exists: /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquired lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 11:59:31 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:31 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-424510986',display_name='tempest-TestVolumeSwap-server-424510986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-424510986',id=10,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeRHp6lcI51HbbQcMViCtaEOMVPIwiZbpOOuW69KRMRwxUN5SbD71ogK9FnPFB/xC43N12nmENS4exUPJyXpGgsaXIfQ/aqUrohgB/U498enroFpQ62J8/aqwLT8Z6yzA==',key_name='tempest-keypair-893721411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e5bd7c2af34f1895644736ec2be7ea',ramdisk_id='',reservation_id='r-9ddsi32i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-618136404',owner_user_name='tempest-TestVolumeSwap-618136404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:59:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80bcc4418bcd41ed8e58266cfd63d5c9',uuid=ddde3963-45a3-4c13-9a58-134d87babeaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Converting VIF {"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=ce5af459-034f-4974-8020-e351fea55ce2,network=Network(2aa1ceb5-f060-458a-ad7c-529e1a87c2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce5af459-03') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lazy-loading 'pci_devices' on Instance uuid ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-b7249728-537d-42f3-ac36-fdc12b3d02b8 req-216f9a7f-1bc8-4e91-b576-e0f0ce4e3fbb service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received event network-changed-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-b7249728-537d-42f3-ac36-fdc12b3d02b8 req-216f9a7f-1bc8-4e91-b576-e0f0ce4e3fbb service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Refreshing instance network info cache due to event network-changed-cbd56403-d002-4dcd-af14-633cad3cb080. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7249728-537d-42f3-ac36-fdc12b3d02b8 req-216f9a7f-1bc8-4e91-b576-e0f0ce4e3fbb service nova] Acquiring lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891171.4343767, 686d22d8-fae6-4035-aeac-c80cbeaff08b => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] VM Resumed (Lifecycle Event)
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:59:31 user nova-compute[72178]:   <uuid>ddde3963-45a3-4c13-9a58-134d87babeaf</uuid>
Aug 01 11:59:31 user nova-compute[72178]:   <name>instance-0000000a</name>
Aug 01 11:59:31 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:59:31 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:59:31 user nova-compute[72178]:   <metadata>
Aug 01 11:59:31 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:59:31 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:59:31 user nova-compute[72178]:       <nova:name>tempest-TestVolumeSwap-server-424510986</nova:name>
Aug 01 11:59:31 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:59:31</nova:creationTime>
Aug 01 11:59:31 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:59:31 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:59:31 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:59:31 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:59:31 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:59:31 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:59:31 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:59:31 user nova-compute[72178]:       <nova:owner>
Aug 01 11:59:31 user nova-compute[72178]:         <nova:user uuid="80bcc4418bcd41ed8e58266cfd63d5c9">tempest-TestVolumeSwap-618136404-project-member</nova:user>
Aug 01 11:59:31 user nova-compute[72178]:         <nova:project uuid="b7e5bd7c2af34f1895644736ec2be7ea">tempest-TestVolumeSwap-618136404</nova:project>
Aug 01 11:59:31 user nova-compute[72178]:       </nova:owner>
Aug 01 11:59:31 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 11:59:31 user nova-compute[72178]:       <nova:ports>
Aug 01 11:59:31 user nova-compute[72178]:         <nova:port uuid="ce5af459-034f-4974-8020-e351fea55ce2">
Aug 01 11:59:31 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 11:59:31 user nova-compute[72178]:         </nova:port>
Aug 01 11:59:31 user nova-compute[72178]:       </nova:ports>
Aug 01 11:59:31 user nova-compute[72178]:     </nova:instance>
Aug 01 11:59:31 user nova-compute[72178]:   </metadata>
Aug 01 11:59:31 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:59:31 user nova-compute[72178]:     <system>
Aug 01 11:59:31 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:59:31 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:59:31 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:59:31 user nova-compute[72178]:       <entry name="serial">ddde3963-45a3-4c13-9a58-134d87babeaf</entry>
Aug 01 11:59:31 user nova-compute[72178]:       <entry name="uuid">ddde3963-45a3-4c13-9a58-134d87babeaf</entry>
Aug 01 11:59:31 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:59:31 user nova-compute[72178]:     </system>
Aug 01 11:59:31 user nova-compute[72178]:   </sysinfo>
Aug 01 11:59:31 user nova-compute[72178]:   <os>
Aug 01 11:59:31 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:59:31 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:59:31 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:59:31 user nova-compute[72178]:   </os>
Aug 01 11:59:31 user nova-compute[72178]:   <features>
Aug 01 11:59:31 user nova-compute[72178]:     <acpi/>
Aug 01 11:59:31 user nova-compute[72178]:     <apic/>
Aug 01 11:59:31 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:59:31 user nova-compute[72178]:   </features>
Aug 01 11:59:31 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:59:31 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:59:31 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:59:31 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:59:31 user nova-compute[72178]:   </clock>
Aug 01 11:59:31 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:59:31 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:59:31 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:59:31 user nova-compute[72178]:   </cpu>
Aug 01 11:59:31 user nova-compute[72178]:   <devices>
Aug 01 11:59:31 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:59:31 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:59:31 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk"/>
Aug 01 11:59:31 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 11:59:31 user nova-compute[72178]:     </disk>
Aug 01 11:59:31 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:59:31 user nova-compute[72178]:       <mac address="fa:16:3e:13:f6:86"/>
Aug 01 11:59:31 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:31 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:59:31 user nova-compute[72178]:       <target dev="tapce5af459-03"/>
Aug 01 11:59:31 user nova-compute[72178]:     </interface>
Aug 01 11:59:31 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:59:31 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/console.log" append="off"/>
Aug 01 11:59:31 user nova-compute[72178]:     </serial>
Aug 01 11:59:31 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:59:31 user nova-compute[72178]:     <video>
Aug 01 11:59:31 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:31 user nova-compute[72178]:     </video>
Aug 01 11:59:31 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:59:31 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:59:31 user nova-compute[72178]:     </rng>
Aug 01 11:59:31 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:59:31 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:59:31 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:59:31 user nova-compute[72178]:     </memballoon>
Aug 01 11:59:31 user nova-compute[72178]:   </devices>
Aug 01 11:59:31 user nova-compute[72178]: </domain>
Aug 01 11:59:31 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-424510986',display_name='tempest-TestVolumeSwap-server-424510986',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-424510986',id=10,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeRHp6lcI51HbbQcMViCtaEOMVPIwiZbpOOuW69KRMRwxUN5SbD71ogK9FnPFB/xC43N12nmENS4exUPJyXpGgsaXIfQ/aqUrohgB/U498enroFpQ62J8/aqwLT8Z6yzA==',key_name='tempest-keypair-893721411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7e5bd7c2af34f1895644736ec2be7ea',ramdisk_id='',reservation_id='r-9ddsi32i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-618136404',owner_user_name='tempest-TestVolumeSwap-618136404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:59:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80bcc4418bcd41ed8e58266cfd63d5c9',uuid=ddde3963-45a3-4c13-9a58-134d87babeaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Converting VIF {"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=ce5af459-034f-4974-8020-e351fea55ce2,network=Network(2aa1ceb5-f060-458a-ad7c-529e1a87c2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce5af459-03') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG os_vif [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=ce5af459-034f-4974-8020-e351fea55ce2,network=Network(2aa1ceb5-f060-458a-ad7c-529e1a87c2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce5af459-03') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce5af459-03, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce5af459-03, col_values=(('external_ids', {'iface-id': 'ce5af459-034f-4974-8020-e351fea55ce2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:f6:86', 'vm-uuid': 'ddde3963-45a3-4c13-9a58-134d87babeaf'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:59:31 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Instance spawned successfully.
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:31 user nova-compute[72178]: INFO os_vif [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=ce5af459-034f-4974-8020-e351fea55ce2,network=Network(2aa1ceb5-f060-458a-ad7c-529e1a87c2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce5af459-03')
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891171.4351792, 686d22d8-fae6-4035-aeac-c80cbeaff08b => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] VM Started (Lifecycle Event)
Aug 01 11:59:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] No VIF found with MAC fa:16:3e:13:f6:86, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:31 user nova-compute[72178]: INFO nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Took 12.75 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Updating instance_info_cache with network_info: [{"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Releasing lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Instance network_info: |[{"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 11:59:32 user nova-compute[72178]: INFO nova.compute.manager [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Took 14.53 seconds to build instance.
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7249728-537d-42f3-ac36-fdc12b3d02b8 req-216f9a7f-1bc8-4e91-b576-e0f0ce4e3fbb service nova] Acquired lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-b7249728-537d-42f3-ac36-fdc12b3d02b8 req-216f9a7f-1bc8-4e91-b576-e0f0ce4e3fbb service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Refreshing network info cache for port cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Start _get_guest_xml network_info=[{"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:59:11Z,direct_url=<?>,disk_format='qcow2',id=87df66e6-21ec-470e-af46-e832c5aad99a,min_disk=0,min_ram=0,name='',owner='41bcd855cb114e36a196eceb875a58c8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:59:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '87df66e6-21ec-470e-af46-e832c5aad99a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40aabaf-4ba2-4a1c-a28e-d5273dbfd7d4 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.797s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:32 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:32 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d36899c-2fcd-4044-af87-82ef60b44f28 req-752de733-987c-4c1b-b45f-c2cf1e96ef97 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Updated VIF entry in instance network info cache for port ce5af459-034f-4974-8020-e351fea55ce2. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d36899c-2fcd-4044-af87-82ef60b44f28 req-752de733-987c-4c1b-b45f-c2cf1e96ef97 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Updating instance_info_cache with network_info: [{"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:59:11Z,direct_url=<?>,disk_format='qcow2',id=87df66e6-21ec-470e-af46-e832c5aad99a,min_disk=0,min_ram=0,name='',owner='41bcd855cb114e36a196eceb875a58c8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:59:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T11:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-178851496',display_name='tempest-AttachSCSIVolumeTestJSON-server-178851496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-178851496',id=11,image_ref='87df66e6-21ec-470e-af46-e832c5aad99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm3XkSaKrT+a3F9H5nshySpm383LZREarF9qoYV4j+J/92Bddk3lNHWKOXTKd+D57VsEC36lbfUC5jO2qFbnLKUlkhNwuvDL5g6DnZm6b6qtDhTVx2V/cqF9PQT1ytgug==',key_name='tempest-keypair-257326513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5de9ff3ea9745a198b1148bba97015b',ramdisk_id='',reservation_id='r-v0iql086',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87df66e6-21ec-470e-af46-e832c5aad99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-130969736',owner_user_name='tempest-AttachSCSIVolumeTestJSON-130969736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3c0d10106a430c965b3c3f86d473f0',uuid=249a69cd-ce20-4613-862d-ec31fa6669e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Converting VIF {"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=cbd56403-d002-4dcd-af14-633cad3cb080,network=Network(e2e17890-d806-4dd3-b7a4-8d27e62636b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd56403-d0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lazy-loading 'pci_devices' on Instance uuid 249a69cd-ce20-4613-862d-ec31fa6669e5 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d36899c-2fcd-4044-af87-82ef60b44f28 req-752de733-987c-4c1b-b45f-c2cf1e96ef97 service nova] Releasing lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] End _get_guest_xml xml=<domain type="kvm">
Aug 01 11:59:32 user nova-compute[72178]:   <uuid>249a69cd-ce20-4613-862d-ec31fa6669e5</uuid>
Aug 01 11:59:32 user nova-compute[72178]:   <name>instance-0000000b</name>
Aug 01 11:59:32 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 11:59:32 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 11:59:32 user nova-compute[72178]:   <metadata>
Aug 01 11:59:32 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 11:59:32 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 11:59:32 user nova-compute[72178]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-178851496</nova:name>
Aug 01 11:59:32 user nova-compute[72178]:       <nova:creationTime>2023-08-01 11:59:32</nova:creationTime>
Aug 01 11:59:32 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 11:59:32 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 11:59:32 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 11:59:32 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 11:59:32 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 11:59:32 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 11:59:32 user nova-compute[72178]:       </nova:flavor>
Aug 01 11:59:32 user nova-compute[72178]:       <nova:owner>
Aug 01 11:59:32 user nova-compute[72178]:         <nova:user uuid="7e3c0d10106a430c965b3c3f86d473f0">tempest-AttachSCSIVolumeTestJSON-130969736-project-member</nova:user>
Aug 01 11:59:32 user nova-compute[72178]:         <nova:project uuid="f5de9ff3ea9745a198b1148bba97015b">tempest-AttachSCSIVolumeTestJSON-130969736</nova:project>
Aug 01 11:59:32 user nova-compute[72178]:       </nova:owner>
Aug 01 11:59:32 user nova-compute[72178]:       <nova:root type="image" uuid="87df66e6-21ec-470e-af46-e832c5aad99a"/>
Aug 01 11:59:32 user nova-compute[72178]:       <nova:ports>
Aug 01 11:59:32 user nova-compute[72178]:         <nova:port uuid="cbd56403-d002-4dcd-af14-633cad3cb080">
Aug 01 11:59:32 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 11:59:32 user nova-compute[72178]:         </nova:port>
Aug 01 11:59:32 user nova-compute[72178]:       </nova:ports>
Aug 01 11:59:32 user nova-compute[72178]:     </nova:instance>
Aug 01 11:59:32 user nova-compute[72178]:   </metadata>
Aug 01 11:59:32 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 11:59:32 user nova-compute[72178]:     <system>
Aug 01 11:59:32 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 11:59:32 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 11:59:32 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 11:59:32 user nova-compute[72178]:       <entry name="serial">249a69cd-ce20-4613-862d-ec31fa6669e5</entry>
Aug 01 11:59:32 user nova-compute[72178]:       <entry name="uuid">249a69cd-ce20-4613-862d-ec31fa6669e5</entry>
Aug 01 11:59:32 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 11:59:32 user nova-compute[72178]:     </system>
Aug 01 11:59:32 user nova-compute[72178]:   </sysinfo>
Aug 01 11:59:32 user nova-compute[72178]:   <os>
Aug 01 11:59:32 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 11:59:32 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 11:59:32 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 11:59:32 user nova-compute[72178]:   </os>
Aug 01 11:59:32 user nova-compute[72178]:   <features>
Aug 01 11:59:32 user nova-compute[72178]:     <acpi/>
Aug 01 11:59:32 user nova-compute[72178]:     <apic/>
Aug 01 11:59:32 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 11:59:32 user nova-compute[72178]:   </features>
Aug 01 11:59:32 user nova-compute[72178]:   <clock offset="utc">
Aug 01 11:59:32 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 11:59:32 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 11:59:32 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 11:59:32 user nova-compute[72178]:   </clock>
Aug 01 11:59:32 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 11:59:32 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 11:59:32 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 11:59:32 user nova-compute[72178]:   </cpu>
Aug 01 11:59:32 user nova-compute[72178]:   <devices>
Aug 01 11:59:32 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 11:59:32 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 11:59:32 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk"/>
Aug 01 11:59:32 user nova-compute[72178]:       <target dev="sda" bus="scsi"/>
Aug 01 11:59:32 user nova-compute[72178]:       <address type="drive" controller="0" unit="0"/>
Aug 01 11:59:32 user nova-compute[72178]:     </disk>
Aug 01 11:59:32 user nova-compute[72178]:     <disk type="file" device="cdrom">
Aug 01 11:59:32 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 11:59:32 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk.config"/>
Aug 01 11:59:32 user nova-compute[72178]:       <target dev="sdb" bus="scsi"/>
Aug 01 11:59:32 user nova-compute[72178]:       <address type="drive" controller="0" unit="1"/>
Aug 01 11:59:32 user nova-compute[72178]:     </disk>
Aug 01 11:59:32 user nova-compute[72178]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 01 11:59:32 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 11:59:32 user nova-compute[72178]:       <mac address="fa:16:3e:f1:52:e1"/>
Aug 01 11:59:32 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:32 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 11:59:32 user nova-compute[72178]:       <target dev="tapcbd56403-d0"/>
Aug 01 11:59:32 user nova-compute[72178]:     </interface>
Aug 01 11:59:32 user nova-compute[72178]:     <serial type="pty">
Aug 01 11:59:32 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/console.log" append="off"/>
Aug 01 11:59:32 user nova-compute[72178]:     </serial>
Aug 01 11:59:32 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 11:59:32 user nova-compute[72178]:     <video>
Aug 01 11:59:32 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 11:59:32 user nova-compute[72178]:     </video>
Aug 01 11:59:32 user nova-compute[72178]:     <rng model="virtio">
Aug 01 11:59:32 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 11:59:32 user nova-compute[72178]:     </rng>
Aug 01 11:59:32 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 11:59:32 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 11:59:32 user nova-compute[72178]:       <stats period="10"/>
Aug 01 11:59:32 user nova-compute[72178]:     </memballoon>
Aug 01 11:59:32 user nova-compute[72178]:   </devices>
Aug 01 11:59:32 user nova-compute[72178]: </domain>
Aug 01 11:59:32 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T11:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-178851496',display_name='tempest-AttachSCSIVolumeTestJSON-server-178851496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-178851496',id=11,image_ref='87df66e6-21ec-470e-af46-e832c5aad99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm3XkSaKrT+a3F9H5nshySpm383LZREarF9qoYV4j+J/92Bddk3lNHWKOXTKd+D57VsEC36lbfUC5jO2qFbnLKUlkhNwuvDL5g6DnZm6b6qtDhTVx2V/cqF9PQT1ytgug==',key_name='tempest-keypair-257326513',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5de9ff3ea9745a198b1148bba97015b',ramdisk_id='',reservation_id='r-v0iql086',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87df66e6-21ec-470e-af46-e832c5aad99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-130969736',owner_user_name='tempest-AttachSCSIVolumeTestJSON-130969736-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3c0d10106a430c965b3c3f86d473f0',uuid=249a69cd-ce20-4613-862d-ec31fa6669e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Converting VIF {"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=cbd56403-d002-4dcd-af14-633cad3cb080,network=Network(e2e17890-d806-4dd3-b7a4-8d27e62636b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd56403-d0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG os_vif [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=cbd56403-d002-4dcd-af14-633cad3cb080,network=Network(e2e17890-d806-4dd3-b7a4-8d27e62636b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd56403-d0') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbd56403-d0, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbd56403-d0, col_values=(('external_ids', {'iface-id': 'cbd56403-d002-4dcd-af14-633cad3cb080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:52:e1', 'vm-uuid': '249a69cd-ce20-4613-862d-ec31fa6669e5'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:32 user nova-compute[72178]: INFO os_vif [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=cbd56403-d002-4dcd-af14-633cad3cb080,network=Network(e2e17890-d806-4dd3-b7a4-8d27e62636b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd56403-d0')
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] No BDM found with device name sda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] No VIF found with MAC fa:16:3e:f1:52:e1, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 11:59:32 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Using config drive
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-b7249728-537d-42f3-ac36-fdc12b3d02b8 req-216f9a7f-1bc8-4e91-b576-e0f0ce4e3fbb service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Updated VIF entry in instance network info cache for port cbd56403-d002-4dcd-af14-633cad3cb080. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-b7249728-537d-42f3-ac36-fdc12b3d02b8 req-216f9a7f-1bc8-4e91-b576-e0f0ce4e3fbb service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Updating instance_info_cache with network_info: [{"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7249728-537d-42f3-ac36-fdc12b3d02b8 req-216f9a7f-1bc8-4e91-b576-e0f0ce4e3fbb service nova] Releasing lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:33 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Creating config drive at /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk.config
Aug 01 11:59:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6ne2anhl {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 11:59:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6ne2anhl" returned: 0 in 0.101s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891177.4479432, ddde3963-45a3-4c13-9a58-134d87babeaf => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] VM Resumed (Lifecycle Event)
Aug 01 11:59:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-3b02c8f7-9ffb-4845-8487-0763da0ea6ee req-49fa7672-4287-4a15-b996-87869ff58bcd service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received event network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3b02c8f7-9ffb-4845-8487-0763da0ea6ee req-49fa7672-4287-4a15-b996-87869ff58bcd service nova] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3b02c8f7-9ffb-4845-8487-0763da0ea6ee req-49fa7672-4287-4a15-b996-87869ff58bcd service nova] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3b02c8f7-9ffb-4845-8487-0763da0ea6ee req-49fa7672-4287-4a15-b996-87869ff58bcd service nova] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-3b02c8f7-9ffb-4845-8487-0763da0ea6ee req-49fa7672-4287-4a15-b996-87869ff58bcd service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] No waiting events found dispatching network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:38 user nova-compute[72178]: WARNING nova.compute.manager [req-3b02c8f7-9ffb-4845-8487-0763da0ea6ee req-49fa7672-4287-4a15-b996-87869ff58bcd service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received unexpected event network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 for instance with vm_state building and task_state spawning.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-2fb74740-2252-4e05-b6a5-7987a0f7563f req-910c8e73-d5a7-4006-b7f3-576d939f3aab service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received event network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2fb74740-2252-4e05-b6a5-7987a0f7563f req-910c8e73-d5a7-4006-b7f3-576d939f3aab service nova] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2fb74740-2252-4e05-b6a5-7987a0f7563f req-910c8e73-d5a7-4006-b7f3-576d939f3aab service nova] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2fb74740-2252-4e05-b6a5-7987a0f7563f req-910c8e73-d5a7-4006-b7f3-576d939f3aab service nova] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-2fb74740-2252-4e05-b6a5-7987a0f7563f req-910c8e73-d5a7-4006-b7f3-576d939f3aab service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] No waiting events found dispatching network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:38 user nova-compute[72178]: WARNING nova.compute.manager [req-2fb74740-2252-4e05-b6a5-7987a0f7563f req-910c8e73-d5a7-4006-b7f3-576d939f3aab service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received unexpected event network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 for instance with vm_state building and task_state spawning.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb711d12-1f2d-4c96-92f3-230b4c66f668 req-2a85715d-6a82-45a5-9e20-8244564509d9 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received event network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb711d12-1f2d-4c96-92f3-230b4c66f668 req-2a85715d-6a82-45a5-9e20-8244564509d9 service nova] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb711d12-1f2d-4c96-92f3-230b4c66f668 req-2a85715d-6a82-45a5-9e20-8244564509d9 service nova] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb711d12-1f2d-4c96-92f3-230b4c66f668 req-2a85715d-6a82-45a5-9e20-8244564509d9 service nova] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb711d12-1f2d-4c96-92f3-230b4c66f668 req-2a85715d-6a82-45a5-9e20-8244564509d9 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] No waiting events found dispatching network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:38 user nova-compute[72178]: WARNING nova.compute.manager [req-bb711d12-1f2d-4c96-92f3-230b4c66f668 req-2a85715d-6a82-45a5-9e20-8244564509d9 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received unexpected event network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 for instance with vm_state building and task_state spawning.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-b73bbbf7-fc18-4495-9ceb-6ef3f92ead66 req-6f6ba2b1-df8d-4471-b8d8-db7549bbd4a7 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received event network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b73bbbf7-fc18-4495-9ceb-6ef3f92ead66 req-6f6ba2b1-df8d-4471-b8d8-db7549bbd4a7 service nova] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b73bbbf7-fc18-4495-9ceb-6ef3f92ead66 req-6f6ba2b1-df8d-4471-b8d8-db7549bbd4a7 service nova] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b73bbbf7-fc18-4495-9ceb-6ef3f92ead66 req-6f6ba2b1-df8d-4471-b8d8-db7549bbd4a7 service nova] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-b73bbbf7-fc18-4495-9ceb-6ef3f92ead66 req-6f6ba2b1-df8d-4471-b8d8-db7549bbd4a7 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] No waiting events found dispatching network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 11:59:38 user nova-compute[72178]: WARNING nova.compute.manager [req-b73bbbf7-fc18-4495-9ceb-6ef3f92ead66 req-6f6ba2b1-df8d-4471-b8d8-db7549bbd4a7 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received unexpected event network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 for instance with vm_state building and task_state spawning.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891177.448278, ddde3963-45a3-4c13-9a58-134d87babeaf => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] VM Started (Lifecycle Event)
Aug 01 11:59:38 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:38 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7753MB free_disk=25.977230072021484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Instance spawned successfully.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Instance spawned successfully.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891177.8194568, 249a69cd-ce20-4613-862d-ec31fa6669e5 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] VM Resumed (Lifecycle Event)
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Took 11.81 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891177.8234634, 249a69cd-ce20-4613-862d-ec31fa6669e5 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 11:59:38 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] VM Started (Lifecycle Event)
Aug 01 11:59:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 11:59:39 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 11:59:39 user nova-compute[72178]: INFO nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Took 14.05 seconds to spawn the instance on the hypervisor.
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 11:59:39 user nova-compute[72178]: INFO nova.compute.manager [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Took 15.08 seconds to build instance.
Aug 01 11:59:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f35cc6d9-3403-4c27-901b-6826467de599 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.427s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:39 user nova-compute[72178]: INFO nova.compute.manager [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Took 16.41 seconds to build instance.
Aug 01 11:59:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b419e306-f66c-4ce6-b0a8-4f8821a38d00 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.603s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a378bfa5-d230-4e81-bc4f-16132501f1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance fc8d64a1-321c-45d7-9db3-1159c91ee9b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 686d22d8-fae6-4035-aeac-c80cbeaff08b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance ddde3963-45a3-4c13-9a58-134d87babeaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 249a69cd-ce20-4613-862d-ec31fa6669e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing inventories for resource provider f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Updating ProviderTree inventory for provider f106307e-ff81-42a0-bae9-51f40c919103 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing aggregate associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, aggregates: None {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 11:59:39 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing trait associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 11:59:40 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 11:59:40 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 11:59:40 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 11:59:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.596s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 11:59:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 11:59:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 11:59:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 11:59:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 11:59:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 11:59:41 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 11:59:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 11:59:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 11:59:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 11:59:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 11:59:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 11:59:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:00:10 user nova-compute[72178]: INFO nova.compute.claims [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Claim successful on node user
Aug 01 12:00:10 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:00:10 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:00:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:00:10 user nova-compute[72178]: INFO nova.virt.block_device [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Booting with volume 116d7afb-beff-4a51-95d6-e15e3311d273 at /dev/vda
Aug 01 12:00:10 user nova-compute[72178]: DEBUG nova.policy [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '89b7c640c2704a67989885f951fbf7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b23388659ea48dda1be9a1b6a2537d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:00:10 user nova-compute[72178]: DEBUG os_brick.utils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:10 user nova-compute[72178]: INFO oslo.privsep.daemon [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmploj1pqm6/privsep.sock']
Aug 01 12:00:10 user sudo[83852]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmploj1pqm6/privsep.sock
Aug 01 12:00:10 user sudo[83852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 01 12:00:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully created port: 192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:00:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully created port: ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully created port: fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:00:12 user sudo[83852]: pam_unix(sudo:session): session closed for user root
Aug 01 12:00:12 user nova-compute[72178]: INFO oslo.privsep.daemon [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Spawned new privsep daemon via rootwrap
Aug 01 12:00:12 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 01 12:00:12 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 01 12:00:12 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 01 12:00:12 user nova-compute[72178]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83857
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45cc24a-5407-4800-80b5-340f08d0d768]: (2,) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7a8e9-24ac-43a2-9704-c2f2e0ca76a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:12 user nova-compute[72178]: WARNING os_brick.initiator.connectors.nvmeof [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dd0f31-eae2-415a-8dfe-10539ac44dcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1faeaa7-7980-4afc-9485-b0814d000c4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1dd97-75b5-4ce4-808d-3de4ef7a70e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:00:12 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:00:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fca37dc-1650-4d05-b65e-31ff23175754]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG os_brick.utils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== get_connector_properties: return (2090ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:12 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating existing volume attachment record: 69b6f570-fbb5-43c2-85c8-8f1b84278a6f {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:00:13 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully created port: 055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:00:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:14 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully created port: 8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:00:14 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully updated port: 192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:00:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-a01ae09f-fb25-49ea-af58-88b5d208082f req-fd3dfccd-84ba-4d4d-9bdd-5e88479fcb16 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-changed-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-a01ae09f-fb25-49ea-af58-88b5d208082f req-fd3dfccd-84ba-4d4d-9bdd-5e88479fcb16 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing instance network info cache due to event network-changed-192e5655-670b-4556-a74b-9f3ac045b973. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a01ae09f-fb25-49ea-af58-88b5d208082f req-fd3dfccd-84ba-4d4d-9bdd-5e88479fcb16 service nova] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a01ae09f-fb25-49ea-af58-88b5d208082f req-fd3dfccd-84ba-4d4d-9bdd-5e88479fcb16 service nova] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:14 user nova-compute[72178]: DEBUG nova.network.neutron [req-a01ae09f-fb25-49ea-af58-88b5d208082f req-fd3dfccd-84ba-4d4d-9bdd-5e88479fcb16 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing network info cache for port 192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:14 user nova-compute[72178]: DEBUG nova.network.neutron [req-a01ae09f-fb25-49ea-af58-88b5d208082f req-fd3dfccd-84ba-4d4d-9bdd-5e88479fcb16 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:00:15 user nova-compute[72178]: DEBUG nova.network.neutron [req-a01ae09f-fb25-49ea-af58-88b5d208082f req-fd3dfccd-84ba-4d4d-9bdd-5e88479fcb16 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a01ae09f-fb25-49ea-af58-88b5d208082f req-fd3dfccd-84ba-4d4d-9bdd-5e88479fcb16 service nova] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:15 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully updated port: 378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:00:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully updated port: a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:00:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-changed-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing instance network info cache due to event network-changed-378bd5f0-98a0-47c7-8583-2643fceeef0e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:16 user nova-compute[72178]: DEBUG nova.network.neutron [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing network info cache for port 378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully updated port: ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-changed-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing instance network info cache due to event network-changed-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing network info cache for port a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10c5e779-0f66-43c7-a779-c66fb9b5935a req-19d6ab96-8805-4bd3-9399-686ed5b22cb8 service nova] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully updated port: fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:00:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-changed-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing instance network info cache due to event network-changed-ba611d3c-04a7-4141-9a95-13264e8dacd1. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing network info cache for port ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully updated port: 055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-changed-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing instance network info cache due to event network-changed-fef3b207-5b27-4d85-8c77-9be9d120bfee. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing network info cache for port fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec45a430-a2a6-4c48-96ee-79453faaadd5 req-d4471b73-c2bc-499c-946b-fca77a9bc16d service nova] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Successfully updated port: 8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:00:19 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:00:20 user nova-compute[72178]: INFO nova.virt.block_device [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Booting with volume 417cde5d-ff21-4060-8f92-40ef4b702f2b at /dev/vdb
Aug 01 12:00:20 user nova-compute[72178]: DEBUG os_brick.utils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf3fbc6-1635-4ea7-bf14-8fa56a7c9803]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9712b116-4c0c-4cd1-a04f-7422b999b79a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[327a1414-ad5a-43a3-b34e-74fca9b57ccd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[436b1cbd-2a72-4e7a-85cd-dac5bcbd2b32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:00:20 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:00:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d527ac2-a70f-4ca8-992e-3c0fb0466f38]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG os_brick.utils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:20 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating existing volume attachment record: 9b7103f8-144c-41ec-bc31-ff2cea07633b {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:00:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-changed-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing instance network info cache due to event network-changed-055aa952-e6f0-4045-a87c-5569479d7175. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:21 user nova-compute[72178]: DEBUG nova.network.neutron [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [{"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance network_info: |[{"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:00:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:21 user nova-compute[72178]: DEBUG nova.network.neutron [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing network info cache for port 055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG nova.network.neutron [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updated VIF entry in instance network info cache for port 055aa952-e6f0-4045-a87c-5569479d7175. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG nova.network.neutron [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [{"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-changed-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing instance network info cache due to event network-changed-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG nova.network.neutron [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing network info cache for port 8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG nova.network.neutron [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updated VIF entry in instance network info cache for port 8e23d40f-539b-4b6c-84dc-2afacd8fd2e2. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG nova.network.neutron [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [{"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb78b83b-feea-4222-8821-1e4cf23c1e7b req-e2d15441-4fba-49bb-836f-e56d9bac91e6 service nova] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:23 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:23 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: INFO nova.virt.block_device [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Booting with volume 753b30b9-d013-45cc-a2d1-322cd1d0cac9 at /dev/vdc
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG os_brick.utils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ea89b-4a23-42ae-a105-c6c39294d2c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21937eb-8411-430c-87f7-f542cd643936]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f03d447-ba4f-40e2-89c5-3b7e6a7460b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d7474-8d05-41eb-906a-30023f459105]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:00:28 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[351e418e-63f9-4c88-ac35-bf7c5c75a55d]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG os_brick.utils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating existing volume attachment record: eb829a54-c511-4fd3-88fe-19bf7b2fc7ee {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:30 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:00:30 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=6614MB free_disk=25.63654327392578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a378bfa5-d230-4e81-bc4f-16132501f1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance fc8d64a1-321c-45d7-9db3-1159c91ee9b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 686d22d8-fae6-4035-aeac-c80cbeaff08b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance ddde3963-45a3-4c13-9a58-134d87babeaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 249a69cd-ce20-4613-862d-ec31fa6669e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 2ff02938-0f05-40d9-a1b2-f916818da57c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:00:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:31 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:00:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:00:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updating instance_info_cache with network_info: [{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:32 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:00:32 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:32 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:00:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:00:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:00:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Creating image(s)
Aug 01 12:00:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:00:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Ensure instance console log exists: /opt/stack/data/nova/instances/2ff02938-0f05-40d9-a1b2-f916818da57c/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:00:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Start _get_guest_xml network_info=[{"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqHigVsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ff02938-0f05-40d9-a1b2-f916818da57c', 'attached_at': '', 'detached_at': '', 'volume_id': '116d7afb-beff-4a51-95d6-e15e3311d273', 'serial': '116d7afb-beff-4a51-95d6-e15e3311d273'}, 'boot_index': 0, 'attachment_id': '69b6f570-fbb5-43c2-85c8-8f1b84278a6f', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsSLEPoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ff02938-0f05-40d9-a1b2-f916818da57c', 'attached_at': '', 'detached_at': '', 'volume_id': '417cde5d-ff21-4060-8f92-40ef4b702f2b', 'serial': '417cde5d-ff21-4060-8f92-40ef4b702f2b'}, 'boot_index': 1, 'attachment_id': '9b7103f8-144c-41ec-bc31-ff2cea07633b', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAbicTnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ff02938-0f05-40d9-a1b2-f916818da57c', 'attached_at': '', 'detached_at': '', 'volume_id': '753b30b9-d013-45cc-a2d1-322cd1d0cac9', 'serial': '753b30b9-d013-45cc-a2d1-322cd1d0cac9'}, 'boot_index': 2, 'attachment_id': 'eb829a54-c511-4fd3-88fe-19bf7b2fc7ee', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:00:36 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:00:36 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connector [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Factory for ISCSI on None {{(pid=72178) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqHigVsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:36 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:36 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:36 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bdd3be-08b9-490f-a834-0ca0d22ba681]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:00:36 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc21e52-552a-43d8-8fca-9d105da91ebe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273] added
Aug 01 12:00:36 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c28438-a252-48de-aacc-9133fd5713b9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1feace-fce3-4a27-b1a1-f1754c0be3b3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqHigVsd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NqHigVsd" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3d620a-adae-44a8-ae5c-7508a3abfb4e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NqHigVsd'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[728e2e7a-6595-4373-a147-e5a771ce5640]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7647a8f-e9a0-40dc-b8ff-33298b364efd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:00:36 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:00:36 user nova-compute[72178]:  {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:36 user nova-compute[72178]: WARNING os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 12:00:36 user nova-compute[72178]: 
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eae6dff-c33f-43c1-96df-0d7c5251bfcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273, portal: 172.16.0.220,3260]
Aug 01 12:00:36 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273, portal: 172.16.0.220,3260] successful.
Aug 01 12:00:36 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[09011a47-9cd7-40f6-ba0a-cc99512a8b26]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[86352718-574a-4851-b42b-6fefce9d8b0b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:36 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:36 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[61571f2e-5814-4fda-81cd-2db7f445d32a]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:00:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqHigVsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26235326534656436', 'path': '/dev/sdb'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235326534656436', 'path': '/dev/sdb'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsSLEPoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:37 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:37 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:37 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ce650a-bb9b-4919-a329-8e8cfabf9f8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:00:37 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad7b2e7-bb99-4c67-ab6a-7a534046e122]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b] added
Aug 01 12:00:37 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba7828c-e736-4fa4-871e-fb71d03f6d65]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.052s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[26250e7f-7aa7-4314-b6c0-4a6dec51d504]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lsSLEPoB {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lsSLEPoB" returned: 0 in 0.037s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d39152-1497-4d24-acad-a771bc1f8539]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lsSLEPoB'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[341072b4-7bf4-4d2c-a613-84664ee7b7dd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab24d5d-a180-4553-957c-9131957e372c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:37 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:37 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c62e37-91fd-4fb0-8c1f-18bc6e2d13ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b, portal: 172.16.0.220,3260]
Aug 01 12:00:37 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b, portal: 172.16.0.220,3260] successful.
Aug 01 12:00:37 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd1d04a-8e7d-4b41-b7b4-e5fb301a45c2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[416aeb69-aeee-4909-af7a-e10c333adec6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:37 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:37 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:37 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:37 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a4c5eb-9ae2-4943-8e53-5b2375459f17]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:00:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsSLEPoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-fa285dc4-bda5-4f25-9ce6-b10ee76b7a19 req-38d23e31-8e0f-4954-8850-d408ca8e6be5 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-changed-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-fa285dc4-bda5-4f25-9ce6-b10ee76b7a19 req-38d23e31-8e0f-4954-8850-d408ca8e6be5 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Refreshing instance network info cache due to event network-changed-c3d72fdf-8035-4c64-8514-366e8e6b2b51. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fa285dc4-bda5-4f25-9ce6-b10ee76b7a19 req-38d23e31-8e0f-4954-8850-d408ca8e6be5 service nova] Acquiring lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fa285dc4-bda5-4f25-9ce6-b10ee76b7a19 req-38d23e31-8e0f-4954-8850-d408ca8e6be5 service nova] Acquired lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG nova.network.neutron [req-fa285dc4-bda5-4f25-9ce6-b10ee76b7a19 req-38d23e31-8e0f-4954-8850-d408ca8e6be5 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Refreshing network info cache for port c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23030303661316636', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030303661316636', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAbicTnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:38 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:38 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:38 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6c9803-d34f-4821-9706-e3039a17ec5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:00:38 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bba356-8a19-42d8-8204-06b6100d1017]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9] added
Aug 01 12:00:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd86cef2-f26c-4330-96d3-f5a637849f5f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91e893e-3723-43aa-bf14-5a992f4ff58a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAbicTnP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OAbicTnP" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9685c390-6b78-41e4-ae94-ae2d4e8435c8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OAbicTnP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e1102e-0c7b-4541-9d6d-7d317e7aa530]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG nova.network.neutron [req-fa285dc4-bda5-4f25-9ce6-b10ee76b7a19 req-38d23e31-8e0f-4954-8850-d408ca8e6be5 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updated VIF entry in instance network info cache for port c3d72fdf-8035-4c64-8514-366e8e6b2b51. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG nova.network.neutron [req-fa285dc4-bda5-4f25-9ce6-b10ee76b7a19 req-38d23e31-8e0f-4954-8850-d408ca8e6be5 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2c6e8-4686-481d-8275-363f371c6075]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:38 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:38 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fa285dc4-bda5-4f25-9ce6-b10ee76b7a19 req-38d23e31-8e0f-4954-8850-d408ca8e6be5 service nova] Releasing lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[267cd580-0ab5-491f-9141-ad8e731fdef3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9, portal: 172.16.0.220,3260]
Aug 01 12:00:38 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9, portal: 172.16.0.220,3260] successful.
Aug 01 12:00:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3e0366-8c8b-40b5-9aea-25dcdfb32223]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c171a546-5b84-4e5d-8afa-28f67ea1119a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:39 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:39 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:00:39 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:39 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:39 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:00:39 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3f0d3b-d77c-4178-8bdb-f2f041ef147a]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAbicTnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:00:39 user nova-compute[72178]: INFO nova.compute.manager [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Rescuing
Aug 01 12:00:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquired lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:39 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23361386235633439', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361386235633439', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:c6:f8,bridge_name='br-int',has_traffic_filtering=True,id=192e5655-670b-4556-a74b-9f3ac045b973,network=Network(ddd5f15f-ece8-401c-ae07-404fa6ca1a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192e5655-67') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=378bd5f0-98a0-47c7-8583-2643fceeef0e,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap378bd5f0-98') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:7b,bridge_name='br-int',has_traffic_filtering=True,id=a55a564d-20e1-4d97-9b4a-f34cf6bf63a8,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa55a564d-20') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:4b,bridge_name='br-int',has_traffic_filtering=True,id=ba611d3c-04a7-4141-9a95-13264e8dacd1,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba611d3c-04') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:e7,bridge_name='br-int',has_traffic_filtering=True,id=fef3b207-5b27-4d85-8c77-9be9d120bfee,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef3b207-5b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:0b:cf,bridge_name='br-int',has_traffic_filtering=True,id=055aa952-e6f0-4045-a87c-5569479d7175,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055aa952-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:44:20,bridge_name='br-int',has_traffic_filtering=True,id=8e23d40f-539b-4b6c-84dc-2afacd8fd2e2,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23d40f-53') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ff02938-0f05-40d9-a1b2-f916818da57c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:00:40 user nova-compute[72178]:   <uuid>2ff02938-0f05-40d9-a1b2-f916818da57c</uuid>
Aug 01 12:00:40 user nova-compute[72178]:   <name>instance-0000000c</name>
Aug 01 12:00:40 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:00:40 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:00:40 user nova-compute[72178]:   <metadata>
Aug 01 12:00:40 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:00:40 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:00:40 user nova-compute[72178]:       <nova:name>tempest-device-tagging-server-386396453</nova:name>
Aug 01 12:00:40 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:00:36</nova:creationTime>
Aug 01 12:00:40 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:00:40 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:00:40 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:00:40 user nova-compute[72178]:       <nova:owner>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:user uuid="89b7c640c2704a67989885f951fbf7d9">tempest-TaggedBootDevicesTest-956691496-project-member</nova:user>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:project uuid="9b23388659ea48dda1be9a1b6a2537d6">tempest-TaggedBootDevicesTest-956691496</nova:project>
Aug 01 12:00:40 user nova-compute[72178]:       </nova:owner>
Aug 01 12:00:40 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:00:40 user nova-compute[72178]:       <nova:ports>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:port uuid="192e5655-670b-4556-a74b-9f3ac045b973">
Aug 01 12:00:40 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 12:00:40 user nova-compute[72178]:         </nova:port>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:port uuid="378bd5f0-98a0-47c7-8583-2643fceeef0e">
Aug 01 12:00:40 user nova-compute[72178]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Aug 01 12:00:40 user nova-compute[72178]:         </nova:port>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:port uuid="a55a564d-20e1-4d97-9b4a-f34cf6bf63a8">
Aug 01 12:00:40 user nova-compute[72178]:           <nova:ip type="fixed" address="10.1.1.223" ipVersion="4"/>
Aug 01 12:00:40 user nova-compute[72178]:         </nova:port>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:port uuid="ba611d3c-04a7-4141-9a95-13264e8dacd1">
Aug 01 12:00:40 user nova-compute[72178]:           <nova:ip type="fixed" address="10.1.1.169" ipVersion="4"/>
Aug 01 12:00:40 user nova-compute[72178]:         </nova:port>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:port uuid="fef3b207-5b27-4d85-8c77-9be9d120bfee">
Aug 01 12:00:40 user nova-compute[72178]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Aug 01 12:00:40 user nova-compute[72178]:         </nova:port>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:port uuid="055aa952-e6f0-4045-a87c-5569479d7175">
Aug 01 12:00:40 user nova-compute[72178]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 12:00:40 user nova-compute[72178]:         </nova:port>
Aug 01 12:00:40 user nova-compute[72178]:         <nova:port uuid="8e23d40f-539b-4b6c-84dc-2afacd8fd2e2">
Aug 01 12:00:40 user nova-compute[72178]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 12:00:40 user nova-compute[72178]:         </nova:port>
Aug 01 12:00:40 user nova-compute[72178]:       </nova:ports>
Aug 01 12:00:40 user nova-compute[72178]:     </nova:instance>
Aug 01 12:00:40 user nova-compute[72178]:   </metadata>
Aug 01 12:00:40 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:00:40 user nova-compute[72178]:     <system>
Aug 01 12:00:40 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:00:40 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:00:40 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:00:40 user nova-compute[72178]:       <entry name="serial">2ff02938-0f05-40d9-a1b2-f916818da57c</entry>
Aug 01 12:00:40 user nova-compute[72178]:       <entry name="uuid">2ff02938-0f05-40d9-a1b2-f916818da57c</entry>
Aug 01 12:00:40 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:00:40 user nova-compute[72178]:     </system>
Aug 01 12:00:40 user nova-compute[72178]:   </sysinfo>
Aug 01 12:00:40 user nova-compute[72178]:   <os>
Aug 01 12:00:40 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:00:40 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:00:40 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:00:40 user nova-compute[72178]:   </os>
Aug 01 12:00:40 user nova-compute[72178]:   <features>
Aug 01 12:00:40 user nova-compute[72178]:     <acpi/>
Aug 01 12:00:40 user nova-compute[72178]:     <apic/>
Aug 01 12:00:40 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:00:40 user nova-compute[72178]:   </features>
Aug 01 12:00:40 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:00:40 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:00:40 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:00:40 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:00:40 user nova-compute[72178]:   </clock>
Aug 01 12:00:40 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:00:40 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:00:40 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:00:40 user nova-compute[72178]:   </cpu>
Aug 01 12:00:40 user nova-compute[72178]:   <devices>
Aug 01 12:00:40 user nova-compute[72178]:     <disk type="file" device="cdrom">
Aug 01 12:00:40 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 12:00:40 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/2ff02938-0f05-40d9-a1b2-f916818da57c/disk.config"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="hda" bus="ide"/>
Aug 01 12:00:40 user nova-compute[72178]:     </disk>
Aug 01 12:00:40 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:00:40 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:00:40 user nova-compute[72178]:       <source dev="/dev/sdb"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <serial>116d7afb-beff-4a51-95d6-e15e3311d273</serial>
Aug 01 12:00:40 user nova-compute[72178]:     </disk>
Aug 01 12:00:40 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:00:40 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:00:40 user nova-compute[72178]:       <source dev="/dev/sdc"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <serial>417cde5d-ff21-4060-8f92-40ef4b702f2b</serial>
Aug 01 12:00:40 user nova-compute[72178]:     </disk>
Aug 01 12:00:40 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:00:40 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:00:40 user nova-compute[72178]:       <source dev="/dev/sdd"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="vdc" bus="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <serial>753b30b9-d013-45cc-a2d1-322cd1d0cac9</serial>
Aug 01 12:00:40 user nova-compute[72178]:     </disk>
Aug 01 12:00:40 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:00:40 user nova-compute[72178]:       <mac address="fa:16:3e:96:c6:f8"/>
Aug 01 12:00:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="tap192e5655-67"/>
Aug 01 12:00:40 user nova-compute[72178]:     </interface>
Aug 01 12:00:40 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:00:40 user nova-compute[72178]:       <mac address="fa:16:3e:1c:40:aa"/>
Aug 01 12:00:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="tap378bd5f0-98"/>
Aug 01 12:00:40 user nova-compute[72178]:     </interface>
Aug 01 12:00:40 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:00:40 user nova-compute[72178]:       <mac address="fa:16:3e:a7:28:7b"/>
Aug 01 12:00:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="tapa55a564d-20"/>
Aug 01 12:00:40 user nova-compute[72178]:     </interface>
Aug 01 12:00:40 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:00:40 user nova-compute[72178]:       <mac address="fa:16:3e:5c:af:4b"/>
Aug 01 12:00:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="tapba611d3c-04"/>
Aug 01 12:00:40 user nova-compute[72178]:     </interface>
Aug 01 12:00:40 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:00:40 user nova-compute[72178]:       <mac address="fa:16:3e:a9:c0:e7"/>
Aug 01 12:00:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="tapfef3b207-5b"/>
Aug 01 12:00:40 user nova-compute[72178]:     </interface>
Aug 01 12:00:40 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:00:40 user nova-compute[72178]:       <mac address="fa:16:3e:b3:0b:cf"/>
Aug 01 12:00:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="tap055aa952-e6"/>
Aug 01 12:00:40 user nova-compute[72178]:     </interface>
Aug 01 12:00:40 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:00:40 user nova-compute[72178]:       <mac address="fa:16:3e:88:44:20"/>
Aug 01 12:00:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:00:40 user nova-compute[72178]:       <target dev="tap8e23d40f-53"/>
Aug 01 12:00:40 user nova-compute[72178]:     </interface>
Aug 01 12:00:40 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:00:40 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/2ff02938-0f05-40d9-a1b2-f916818da57c/console.log" append="off"/>
Aug 01 12:00:40 user nova-compute[72178]:     </serial>
Aug 01 12:00:40 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:00:40 user nova-compute[72178]:     <video>
Aug 01 12:00:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:40 user nova-compute[72178]:     </video>
Aug 01 12:00:40 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:00:40 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:00:40 user nova-compute[72178]:     </rng>
Aug 01 12:00:40 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:00:40 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:00:40 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:00:40 user nova-compute[72178]:     </memballoon>
Aug 01 12:00:40 user nova-compute[72178]:   </devices>
Aug 01 12:00:40 user nova-compute[72178]: </domain>
Aug 01 12:00:40 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:c6:f8,bridge_name='br-int',has_traffic_filtering=True,id=192e5655-670b-4556-a74b-9f3ac045b973,network=Network(ddd5f15f-ece8-401c-ae07-404fa6ca1a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192e5655-67') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:c6:f8,bridge_name='br-int',has_traffic_filtering=True,id=192e5655-670b-4556-a74b-9f3ac045b973,network=Network(ddd5f15f-ece8-401c-ae07-404fa6ca1a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192e5655-67') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap192e5655-67, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap192e5655-67, col_values=(('external_ids', {'iface-id': '192e5655-670b-4556-a74b-9f3ac045b973', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:c6:f8', 'vm-uuid': '2ff02938-0f05-40d9-a1b2-f916818da57c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: INFO os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:c6:f8,bridge_name='br-int',has_traffic_filtering=True,id=192e5655-670b-4556-a74b-9f3ac045b973,network=Network(ddd5f15f-ece8-401c-ae07-404fa6ca1a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192e5655-67')
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=378bd5f0-98a0-47c7-8583-2643fceeef0e,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap378bd5f0-98') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=378bd5f0-98a0-47c7-8583-2643fceeef0e,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap378bd5f0-98') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap378bd5f0-98, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap378bd5f0-98, col_values=(('external_ids', {'iface-id': '378bd5f0-98a0-47c7-8583-2643fceeef0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:40:aa', 'vm-uuid': '2ff02938-0f05-40d9-a1b2-f916818da57c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: INFO os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=378bd5f0-98a0-47c7-8583-2643fceeef0e,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap378bd5f0-98')
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:7b,bridge_name='br-int',has_traffic_filtering=True,id=a55a564d-20e1-4d97-9b4a-f34cf6bf63a8,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa55a564d-20') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:7b,bridge_name='br-int',has_traffic_filtering=True,id=a55a564d-20e1-4d97-9b4a-f34cf6bf63a8,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa55a564d-20') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa55a564d-20, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa55a564d-20, col_values=(('external_ids', {'iface-id': 'a55a564d-20e1-4d97-9b4a-f34cf6bf63a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:28:7b', 'vm-uuid': '2ff02938-0f05-40d9-a1b2-f916818da57c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: INFO os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:7b,bridge_name='br-int',has_traffic_filtering=True,id=a55a564d-20e1-4d97-9b4a-f34cf6bf63a8,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa55a564d-20')
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:4b,bridge_name='br-int',has_traffic_filtering=True,id=ba611d3c-04a7-4141-9a95-13264e8dacd1,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba611d3c-04') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:4b,bridge_name='br-int',has_traffic_filtering=True,id=ba611d3c-04a7-4141-9a95-13264e8dacd1,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba611d3c-04') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba611d3c-04, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba611d3c-04, col_values=(('external_ids', {'iface-id': 'ba611d3c-04a7-4141-9a95-13264e8dacd1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:af:4b', 'vm-uuid': '2ff02938-0f05-40d9-a1b2-f916818da57c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: INFO os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:4b,bridge_name='br-int',has_traffic_filtering=True,id=ba611d3c-04a7-4141-9a95-13264e8dacd1,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba611d3c-04')
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:e7,bridge_name='br-int',has_traffic_filtering=True,id=fef3b207-5b27-4d85-8c77-9be9d120bfee,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef3b207-5b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:e7,bridge_name='br-int',has_traffic_filtering=True,id=fef3b207-5b27-4d85-8c77-9be9d120bfee,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef3b207-5b') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfef3b207-5b, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfef3b207-5b, col_values=(('external_ids', {'iface-id': 'fef3b207-5b27-4d85-8c77-9be9d120bfee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:c0:e7', 'vm-uuid': '2ff02938-0f05-40d9-a1b2-f916818da57c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: INFO os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:e7,bridge_name='br-int',has_traffic_filtering=True,id=fef3b207-5b27-4d85-8c77-9be9d120bfee,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef3b207-5b')
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:0b:cf,bridge_name='br-int',has_traffic_filtering=True,id=055aa952-e6f0-4045-a87c-5569479d7175,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055aa952-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:0b:cf,bridge_name='br-int',has_traffic_filtering=True,id=055aa952-e6f0-4045-a87c-5569479d7175,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055aa952-e6') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap055aa952-e6, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap055aa952-e6, col_values=(('external_ids', {'iface-id': '055aa952-e6f0-4045-a87c-5569479d7175', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:0b:cf', 'vm-uuid': '2ff02938-0f05-40d9-a1b2-f916818da57c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: INFO os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:0b:cf,bridge_name='br-int',has_traffic_filtering=True,id=055aa952-e6f0-4045-a87c-5569479d7175,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055aa952-e6')
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:44:20,bridge_name='br-int',has_traffic_filtering=True,id=8e23d40f-539b-4b6c-84dc-2afacd8fd2e2,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23d40f-53') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:44:20,bridge_name='br-int',has_traffic_filtering=True,id=8e23d40f-539b-4b6c-84dc-2afacd8fd2e2,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23d40f-53') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e23d40f-53, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e23d40f-53, col_values=(('external_ids', {'iface-id': '8e23d40f-539b-4b6c-84dc-2afacd8fd2e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:44:20', 'vm-uuid': '2ff02938-0f05-40d9-a1b2-f916818da57c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updating instance_info_cache with network_info: [{"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Releasing lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: INFO os_vif [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:44:20,bridge_name='br-int',has_traffic_filtering=True,id=8e23d40f-539b-4b6c-84dc-2afacd8fd2e2,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23d40f-53')
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] No BDM found with device name hda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] No VIF found with MAC fa:16:3e:96:c6:f8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:00:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] No VIF found with MAC fa:16:3e:a9:c0:e7, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:00:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Using config drive
Aug 01 12:00:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Creating config drive at /opt/stack/data/nova/instances/2ff02938-0f05-40d9-a1b2-f916818da57c/disk.config
Aug 01 12:00:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2ff02938-0f05-40d9-a1b2-f916818da57c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyxg09fvj {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2ff02938-0f05-40d9-a1b2-f916818da57c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyxg09fvj" returned: 0 in 0.073s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-626672a7-732c-4ac3-b234-de9b685749e4 req-dfa65b1b-696b-4423-8817-06f4beb850f4 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-unplugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-626672a7-732c-4ac3-b234-de9b685749e4 req-dfa65b1b-696b-4423-8817-06f4beb850f4 service nova] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-626672a7-732c-4ac3-b234-de9b685749e4 req-dfa65b1b-696b-4423-8817-06f4beb850f4 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-626672a7-732c-4ac3-b234-de9b685749e4 req-dfa65b1b-696b-4423-8817-06f4beb850f4 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-626672a7-732c-4ac3-b234-de9b685749e4 req-dfa65b1b-696b-4423-8817-06f4beb850f4 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] No waiting events found dispatching network-vif-unplugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:41 user nova-compute[72178]: WARNING nova.compute.manager [req-626672a7-732c-4ac3-b234-de9b685749e4 req-dfa65b1b-696b-4423-8817-06f4beb850f4 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received unexpected event network-vif-unplugged-729998f1-8451-468a-a2d8-8612146ac1e3 for instance with vm_state active and task_state rescuing.
Aug 01 12:00:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Instance destroyed successfully.
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-53600ddd-93ca-485b-be38-a0b6159b527b req-9baa49e7-c742-4113-a9c4-11ab1bf19f9b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-changed-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-53600ddd-93ca-485b-be38-a0b6159b527b req-9baa49e7-c742-4113-a9c4-11ab1bf19f9b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Refreshing instance network info cache due to event network-changed-326dc903-e97e-4cde-bd42-5145785c4f92. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-53600ddd-93ca-485b-be38-a0b6159b527b req-9baa49e7-c742-4113-a9c4-11ab1bf19f9b service nova] Acquiring lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-53600ddd-93ca-485b-be38-a0b6159b527b req-9baa49e7-c742-4113-a9c4-11ab1bf19f9b service nova] Acquired lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.network.neutron [req-53600ddd-93ca-485b-be38-a0b6159b527b req-9baa49e7-c742-4113-a9c4-11ab1bf19f9b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Refreshing network info cache for port 326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Attempting rescue
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72178) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Instance directory exists: not creating {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 12:00:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Creating image(s)
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'trusted_certs' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:41 user nova-compute[72178]: INFO nova.compute.manager [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] instance snapshotting
Aug 01 12:00:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Beginning live snapshot process
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.174s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue" returned: 0 in 0.069s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'migration_context' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Start _get_guest_xml network_info=[{"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "vif_mac": "fa:16:3e:c3:3c:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'resources' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'numa_topology' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:42 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:00:42 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'vcpu_model' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-187040838',display_name='tempest-ServerRescueNegativeTestJSON-server-187040838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-187040838',id=5,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-r0egeg4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:59:10Z,user_data=None,user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=326f0759-29ce-4441-ba2a-7a74d8726eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "vif_mac": "fa:16:3e:c3:3c:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "vif_mac": "fa:16:3e:c3:3c:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:3c:55,bridge_name='br-int',has_traffic_filtering=True,id=729998f1-8451-468a-a2d8-8612146ac1e3,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap729998f1-84') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'pci_devices' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json -f qcow2 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:00:42 user nova-compute[72178]:   <uuid>326f0759-29ce-4441-ba2a-7a74d8726eb7</uuid>
Aug 01 12:00:42 user nova-compute[72178]:   <name>instance-00000005</name>
Aug 01 12:00:42 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:00:42 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:00:42 user nova-compute[72178]:   <metadata>
Aug 01 12:00:42 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:00:42 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:00:42 user nova-compute[72178]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-187040838</nova:name>
Aug 01 12:00:42 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:00:42</nova:creationTime>
Aug 01 12:00:42 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:00:42 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:00:42 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:00:42 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:00:42 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:00:42 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:00:42 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:00:42 user nova-compute[72178]:       <nova:owner>
Aug 01 12:00:42 user nova-compute[72178]:         <nova:user uuid="6f27c80bc14843e6a250f1df6e40f26f">tempest-ServerRescueNegativeTestJSON-1377634293-project-member</nova:user>
Aug 01 12:00:42 user nova-compute[72178]:         <nova:project uuid="ee85194306f544e8be7c1a8d2ba4656c">tempest-ServerRescueNegativeTestJSON-1377634293</nova:project>
Aug 01 12:00:42 user nova-compute[72178]:       </nova:owner>
Aug 01 12:00:42 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:00:42 user nova-compute[72178]:       <nova:ports>
Aug 01 12:00:42 user nova-compute[72178]:         <nova:port uuid="729998f1-8451-468a-a2d8-8612146ac1e3">
Aug 01 12:00:42 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 12:00:42 user nova-compute[72178]:         </nova:port>
Aug 01 12:00:42 user nova-compute[72178]:       </nova:ports>
Aug 01 12:00:42 user nova-compute[72178]:     </nova:instance>
Aug 01 12:00:42 user nova-compute[72178]:   </metadata>
Aug 01 12:00:42 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:00:42 user nova-compute[72178]:     <system>
Aug 01 12:00:42 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:00:42 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:00:42 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:00:42 user nova-compute[72178]:       <entry name="serial">326f0759-29ce-4441-ba2a-7a74d8726eb7</entry>
Aug 01 12:00:42 user nova-compute[72178]:       <entry name="uuid">326f0759-29ce-4441-ba2a-7a74d8726eb7</entry>
Aug 01 12:00:42 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:00:42 user nova-compute[72178]:     </system>
Aug 01 12:00:42 user nova-compute[72178]:   </sysinfo>
Aug 01 12:00:42 user nova-compute[72178]:   <os>
Aug 01 12:00:42 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:00:42 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:00:42 user nova-compute[72178]:   </os>
Aug 01 12:00:42 user nova-compute[72178]:   <features>
Aug 01 12:00:42 user nova-compute[72178]:     <acpi/>
Aug 01 12:00:42 user nova-compute[72178]:     <apic/>
Aug 01 12:00:42 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:00:42 user nova-compute[72178]:   </features>
Aug 01 12:00:42 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:00:42 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:00:42 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:00:42 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:00:42 user nova-compute[72178]:   </clock>
Aug 01 12:00:42 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:00:42 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:00:42 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:00:42 user nova-compute[72178]:   </cpu>
Aug 01 12:00:42 user nova-compute[72178]:   <devices>
Aug 01 12:00:42 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:00:42 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:00:42 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue"/>
Aug 01 12:00:42 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:00:42 user nova-compute[72178]:     </disk>
Aug 01 12:00:42 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:00:42 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:00:42 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk"/>
Aug 01 12:00:42 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:00:42 user nova-compute[72178]:     </disk>
Aug 01 12:00:42 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:00:42 user nova-compute[72178]:       <mac address="fa:16:3e:c3:3c:55"/>
Aug 01 12:00:42 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:42 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:00:42 user nova-compute[72178]:       <target dev="tap729998f1-84"/>
Aug 01 12:00:42 user nova-compute[72178]:     </interface>
Aug 01 12:00:42 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:00:42 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/console.log" append="off"/>
Aug 01 12:00:42 user nova-compute[72178]:     </serial>
Aug 01 12:00:42 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:00:42 user nova-compute[72178]:     <video>
Aug 01 12:00:42 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:00:42 user nova-compute[72178]:     </video>
Aug 01 12:00:42 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:00:42 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:00:42 user nova-compute[72178]:     </rng>
Aug 01 12:00:42 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:00:42 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:00:42 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:00:42 user nova-compute[72178]:     </memballoon>
Aug 01 12:00:42 user nova-compute[72178]:   </devices>
Aug 01 12:00:42 user nova-compute[72178]: </domain>
Aug 01 12:00:42 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:00:42 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Instance destroyed successfully.
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No VIF found with MAC fa:16:3e:c3:3c:55, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json -f qcow2 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.network.neutron [req-53600ddd-93ca-485b-be38-a0b6159b527b req-9baa49e7-c742-4113-a9c4-11ab1bf19f9b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updated VIF entry in instance network info cache for port 326dc903-e97e-4cde-bd42-5145785c4f92. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.network.neutron [req-53600ddd-93ca-485b-be38-a0b6159b527b req-9baa49e7-c742-4113-a9c4-11ab1bf19f9b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-53600ddd-93ca-485b-be38-a0b6159b527b req-9baa49e7-c742-4113-a9c4-11ab1bf19f9b service nova] Releasing lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.181s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7pv_avf_/a0d08eaecea944049d3708f57bcadee7.delta 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7pv_avf_/a0d08eaecea944049d3708f57bcadee7.delta 1073741824" returned: 0 in 0.056s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:42 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 12:00:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72178) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 01 12:00:42 user nova-compute[72178]: INFO nova.virt.libvirt.host [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] UEFI support detected
Aug 01 12:00:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:43 user nova-compute[72178]: INFO nova.compute.manager [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Shelving
Aug 01 12:00:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-212233cb-006f-4bac-9a7f-adcd4096d1a2 req-7cf89762-7bbb-4d2a-8273-f710c0f73248 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-212233cb-006f-4bac-9a7f-adcd4096d1a2 req-7cf89762-7bbb-4d2a-8273-f710c0f73248 service nova] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-212233cb-006f-4bac-9a7f-adcd4096d1a2 req-7cf89762-7bbb-4d2a-8273-f710c0f73248 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-212233cb-006f-4bac-9a7f-adcd4096d1a2 req-7cf89762-7bbb-4d2a-8273-f710c0f73248 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-212233cb-006f-4bac-9a7f-adcd4096d1a2 req-7cf89762-7bbb-4d2a-8273-f710c0f73248 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] No waiting events found dispatching network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:43 user nova-compute[72178]: WARNING nova.compute.manager [req-212233cb-006f-4bac-9a7f-adcd4096d1a2 req-7cf89762-7bbb-4d2a-8273-f710c0f73248 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received unexpected event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 for instance with vm_state active and task_state rescuing.
Aug 01 12:00:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-5118ca33-dbff-4acd-8923-db2aa7d5e494 req-c2838211-65e2-414b-b4b9-e436093c9cd8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5118ca33-dbff-4acd-8923-db2aa7d5e494 req-c2838211-65e2-414b-b4b9-e436093c9cd8 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5118ca33-dbff-4acd-8923-db2aa7d5e494 req-c2838211-65e2-414b-b4b9-e436093c9cd8 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5118ca33-dbff-4acd-8923-db2aa7d5e494 req-c2838211-65e2-414b-b4b9-e436093c9cd8 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-5118ca33-dbff-4acd-8923-db2aa7d5e494 req-c2838211-65e2-414b-b4b9-e436093c9cd8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:43 user nova-compute[72178]: WARNING nova.compute.manager [req-5118ca33-dbff-4acd-8923-db2aa7d5e494 req-c2838211-65e2-414b-b4b9-e436093c9cd8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 for instance with vm_state building and task_state spawning.
Aug 01 12:00:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG nova.objects.instance [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lazy-loading 'flavor' on Instance uuid fc8d64a1-321c-45d7-9db3-1159c91ee9b7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:44 user nova-compute[72178]: INFO nova.compute.manager [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Attaching volume 5d3d99a1-b0ef-404e-83da-203a1fc581b3 to /dev/vdb
Aug 01 12:00:44 user nova-compute[72178]: DEBUG os_brick.utils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e817760-51f1-4ab8-966c-eac89584789d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ae2a7-d3c8-41de-85a8-c8398506aca2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbdcd4c-5f93-4544-9509-f7c802037789]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc7c045-64e0-43dc-8f50-9ff09c91c611]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:00:44 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:00:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d2a36a-e875-4019-a48e-222df6bb64f2]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG os_brick.utils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:44 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Updating existing volume attachment record: e1eb7825-bd00-4203-8600-471ea7885085 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] COPY block job progress, current cursor: 1048576 final cursor: 75497472 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:00:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 12:00:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-1ea0083c-4123-4154-acb9-1135f7f2bfee req-d11d59d1-2e75-4d13-aa57-3d6930530642 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ea0083c-4123-4154-acb9-1135f7f2bfee req-d11d59d1-2e75-4d13-aa57-3d6930530642 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ea0083c-4123-4154-acb9-1135f7f2bfee req-d11d59d1-2e75-4d13-aa57-3d6930530642 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ea0083c-4123-4154-acb9-1135f7f2bfee req-d11d59d1-2e75-4d13-aa57-3d6930530642 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-1ea0083c-4123-4154-acb9-1135f7f2bfee req-d11d59d1-2e75-4d13-aa57-3d6930530642 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:45 user nova-compute[72178]: WARNING nova.compute.manager [req-1ea0083c-4123-4154-acb9-1135f7f2bfee req-d11d59d1-2e75-4d13-aa57-3d6930530642 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 for instance with vm_state building and task_state spawning.
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance destroyed successfully.
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Beginning cold snapshot process
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-changed-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Refreshing instance network info cache due to event network-changed-af72e448-83b0-4bec-8ead-79148cc4213c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquiring lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquired lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG nova.network.neutron [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Refreshing network info cache for port af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk /opt/stack/data/nova/instances/snapshots/tmpyb3t7tdh/dc0490de2eaa40bf84fa3d6252c6dd89 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-a7afe4e1-71d0-43ff-81ae-d87fbc681cd0 req-1c44dcca-0d6e-4437-b7a9-6eef57d26f9d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a7afe4e1-71d0-43ff-81ae-d87fbc681cd0 req-1c44dcca-0d6e-4437-b7a9-6eef57d26f9d service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a7afe4e1-71d0-43ff-81ae-d87fbc681cd0 req-1c44dcca-0d6e-4437-b7a9-6eef57d26f9d service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a7afe4e1-71d0-43ff-81ae-d87fbc681cd0 req-1c44dcca-0d6e-4437-b7a9-6eef57d26f9d service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-a7afe4e1-71d0-43ff-81ae-d87fbc681cd0 req-1c44dcca-0d6e-4437-b7a9-6eef57d26f9d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:46 user nova-compute[72178]: WARNING nova.compute.manager [req-a7afe4e1-71d0-43ff-81ae-d87fbc681cd0 req-1c44dcca-0d6e-4437-b7a9-6eef57d26f9d service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 for instance with vm_state building and task_state spawning.
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7pv_avf_/a0d08eaecea944049d3708f57bcadee7.delta /opt/stack/data/nova/instances/snapshots/tmp7pv_avf_/a0d08eaecea944049d3708f57bcadee7 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:46 user nova-compute[72178]: INFO nova.compute.manager [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] instance snapshotting
Aug 01 12:00:46 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Beginning live snapshot process
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json -f qcow2 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7pv_avf_/a0d08eaecea944049d3708f57bcadee7.delta /opt/stack/data/nova/instances/snapshots/tmp7pv_avf_/a0d08eaecea944049d3708f57bcadee7" returned: 0 in 0.875s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:47 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Snapshot extracted, beginning image upload
Aug 01 12:00:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk /opt/stack/data/nova/instances/snapshots/tmpyb3t7tdh/dc0490de2eaa40bf84fa3d6252c6dd89" returned: 0 in 1.087s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:47 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Snapshot extracted, beginning image upload
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json -f qcow2 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG nova.network.neutron [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updated VIF entry in instance network info cache for port af72e448-83b0-4bec-8ead-79148cc4213c. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG nova.network.neutron [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Releasing lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-changed-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Refreshing instance network info cache due to event network-changed-5f9f171c-75e5-4362-8075-9051f6fbcabe. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquiring lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquired lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG nova.network.neutron [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Refreshing network info cache for port 5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-fc479b10-6d6f-4391-9f04-eb12d2106d9e req-2b9a1e74-0263-40d9-b8a8-d3b2c12fe492 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fc479b10-6d6f-4391-9f04-eb12d2106d9e req-2b9a1e74-0263-40d9-b8a8-d3b2c12fe492 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fc479b10-6d6f-4391-9f04-eb12d2106d9e req-2b9a1e74-0263-40d9-b8a8-d3b2c12fe492 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fc479b10-6d6f-4391-9f04-eb12d2106d9e req-2b9a1e74-0263-40d9-b8a8-d3b2c12fe492 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-fc479b10-6d6f-4391-9f04-eb12d2106d9e req-2b9a1e74-0263-40d9-b8a8-d3b2c12fe492 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:47 user nova-compute[72178]: WARNING nova.compute.manager [req-fc479b10-6d6f-4391-9f04-eb12d2106d9e req-2b9a1e74-0263-40d9-b8a8-d3b2c12fe492 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 for instance with vm_state building and task_state spawning.
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json -f qcow2" returned: 0 in 0.553s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.225s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcci_psqw/ee6f76ea9fe4435d9391f00a152aafb5.delta 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcci_psqw/ee6f76ea9fe4435d9391f00a152aafb5.delta 1073741824" returned: 0 in 0.073s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:48 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee for instance with vm_state building and task_state spawning.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-673864cf-1824-4f0b-89a3-52d0c742b549 req-e25f31f5-3e25-450d-80cf-914418aef055 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee for instance with vm_state building and task_state spawning.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 for instance with vm_state building and task_state spawning.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] No waiting events found dispatching network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received unexpected event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 for instance with vm_state active and task_state rescuing.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] No waiting events found dispatching network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received unexpected event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 for instance with vm_state active and task_state rescuing.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 for instance with vm_state building and task_state spawning.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-0c656698-4a3a-4453-9f13-963978c57224 req-5af111f9-472a-4c45-b38b-e682e3859b29 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 for instance with vm_state building and task_state spawning.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updated VIF entry in instance network info cache for port 5f9f171c-75e5-4362-8075-9051f6fbcabe. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Releasing lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 for instance with vm_state building and task_state spawning.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-unplugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] No waiting events found dispatching network-vif-unplugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received unexpected event network-vif-unplugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] No waiting events found dispatching network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received unexpected event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e for instance with vm_state building and task_state spawning.
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:48 user nova-compute[72178]: WARNING nova.compute.manager [req-f381415d-18ab-44ec-82e2-501790a2b757 req-d03304a2-1d44-4469-99c0-8ed04255c6ab service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e for instance with vm_state building and task_state spawning.
Aug 01 12:00:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:00:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 12:00:49 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcci_psqw/ee6f76ea9fe4435d9391f00a152aafb5.delta /opt/stack/data/nova/instances/snapshots/tmpcci_psqw/ee6f76ea9fe4435d9391f00a152aafb5 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:49 user nova-compute[72178]: WARNING nova.compute.manager [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 for instance with vm_state building and task_state spawning.
Aug 01 12:00:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:49 user nova-compute[72178]: WARNING nova.compute.manager [req-a3328123-743e-4037-9d42-996d614b1bc8 req-5fd85a22-dcf1-455d-bea1-22b4c0bd004a service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 for instance with vm_state building and task_state spawning.
Aug 01 12:00:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcci_psqw/ee6f76ea9fe4435d9391f00a152aafb5.delta /opt/stack/data/nova/instances/snapshots/tmpcci_psqw/ee6f76ea9fe4435d9391f00a152aafb5" returned: 0 in 0.278s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Snapshot extracted, beginning image upload
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0bf48384-b421-4b72-a050-15226159b337 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for 326f0759-29ce-4441-ba2a-7a74d8726eb7 due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891250.2519238, 326f0759-29ce-4441-ba2a-7a74d8726eb7 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:00:50 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] VM Resumed (Lifecycle Event)
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:00:50 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891250.2547276, 326f0759-29ce-4441-ba2a-7a74d8726eb7 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:00:50 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] VM Started (Lifecycle Event)
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:00:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Snapshot image upload complete
Aug 01 12:00:50 user nova-compute[72178]: INFO nova.compute.manager [None req-a76ece00-a3a5-4a52-844f-49e1f4f82f41 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Took 8.86 seconds to snapshot the instance on the hypervisor.
Aug 01 12:00:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Snapshot image upload complete
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:50 user nova-compute[72178]: INFO nova.compute.manager [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Shelve offloading
Aug 01 12:00:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance destroyed successfully.
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquired lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:50 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891251.0248137, 2ff02938-0f05-40d9-a1b2-f916818da57c => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:00:51 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] VM Resumed (Lifecycle Event)
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:00:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance spawned successfully.
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:00:51 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891251.0272315, 2ff02938-0f05-40d9-a1b2-f916818da57c => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:00:51 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] VM Started (Lifecycle Event)
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:00:51 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:00:51 user nova-compute[72178]: INFO nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Took 15.25 seconds to spawn the instance on the hypervisor.
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:00:51 user nova-compute[72178]: INFO nova.compute.manager [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Took 41.31 seconds to build instance.
Aug 01 12:00:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-68c423d9-b6f6-448e-9a89-8e19dadd12cb tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.412s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Releasing lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance destroyed successfully.
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'resources' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1036967952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1036967952',id=1,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/k0AF0iCovyXTACa5eh3dd6pxRNW/SUFtSHtOjmemB5IfF7kyYOtdWAYj/Gd497SIk8ZXd8uhZGLK6NnghFD57HW695kxmzHbA12mCcmXuNymqYCZmag/37hQCZWCzcA==',key_name='tempest-keypair-644047153',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-n6me8y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member',shelved_at='2023-08-01T12:00:50.863414',shelved_host='user',shelved_image_id='39524984-95a7-4bda-99c7-6723a15b99d6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=a378bfa5-d230-4e81-bc4f-16132501f1df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG os_vif [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d72fdf-80, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-0f47d688-132a-42f3-8b48-ba7b1c2c2828 req-0476482b-08dd-4c29-b503-31a49b99e798 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-changed-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-0f47d688-132a-42f3-8b48-ba7b1c2c2828 req-0476482b-08dd-4c29-b503-31a49b99e798 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Refreshing instance network info cache due to event network-changed-c3d72fdf-8035-4c64-8514-366e8e6b2b51. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0f47d688-132a-42f3-8b48-ba7b1c2c2828 req-0476482b-08dd-4c29-b503-31a49b99e798 service nova] Acquiring lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0f47d688-132a-42f3-8b48-ba7b1c2c2828 req-0476482b-08dd-4c29-b503-31a49b99e798 service nova] Acquired lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.network.neutron [req-0f47d688-132a-42f3-8b48-ba7b1c2c2828 req-0476482b-08dd-4c29-b503-31a49b99e798 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Refreshing network info cache for port c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:00:52 user nova-compute[72178]: INFO os_vif [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80')
Aug 01 12:00:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Deleting instance files /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df_del
Aug 01 12:00:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Deletion of /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df_del complete
Aug 01 12:00:52 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Deleted allocations for instance a378bfa5-d230-4e81-bc4f-16132501f1df
Aug 01 12:00:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'numa_topology' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Snapshot image upload complete
Aug 01 12:00:52 user nova-compute[72178]: INFO nova.compute.manager [None req-4972dcc9-c811-41fe-8842-76df4c305ec5 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Took 6.41 seconds to snapshot the instance on the hypervisor.
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:00:52 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b1b4ce49-e42a-4853-be84-de5d7909c9be tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.849s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG nova.network.neutron [req-0f47d688-132a-42f3-8b48-ba7b1c2c2828 req-0476482b-08dd-4c29-b503-31a49b99e798 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updated VIF entry in instance network info cache for port c3d72fdf-8035-4c64-8514-366e8e6b2b51. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG nova.network.neutron [req-0f47d688-132a-42f3-8b48-ba7b1c2c2828 req-0476482b-08dd-4c29-b503-31a49b99e798 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0f47d688-132a-42f3-8b48-ba7b1c2c2828 req-0476482b-08dd-4c29-b503-31a49b99e798 service nova] Releasing lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVGfzLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:53 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:53 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:53 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c78a359-c886-4ea4-9698-09e8783b891c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:00:53 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a35cd39-030d-4d12-bfd0-4082ac8cea7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3] added
Aug 01 12:00:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4396f36-e4dc-4a33-b268-fe897d43c999]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[558467dd-2755-4e67-a706-9f6abeba9a68]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heVGfzLb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v heVGfzLb" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1508ed95-0119-4dec-8aeb-7cd6451b90c4]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'heVGfzLb'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ceea0f-6fac-4b54-ad17-27f2269d5fe2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb54a09-3b4d-4ab2-80d5-c5c9b335d052]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[19084e57-fa7d-4fcf-8e6f-c2d40c409176]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3, portal: 172.16.0.220,3260]
Aug 01 12:00:54 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3, portal: 172.16.0.220,3260] successful.
Aug 01 12:00:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aef997-1a88-4164-8d5d-a43e51875093]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[380ac490-a8db-40bc-8111-4f682de946a3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 (non-flash)
Aug 01 12:00:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a379792e-11fd-40ce-9573-431ae63ac8d1]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:00:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVGfzLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23566306664613038', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566306664613038', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG nova.objects.instance [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lazy-loading 'flavor' on Instance uuid fc8d64a1-321c-45d7-9db3-1159c91ee9b7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:00:55 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:00:55 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:00:55 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:00:55 user nova-compute[72178]:   <serial>5d3d99a1-b0ef-404e-83da-203a1fc581b3</serial>
Aug 01 12:00:55 user nova-compute[72178]: </disk>
Aug 01 12:00:55 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] No VIF found with MAC fa:16:3e:ae:b7:da, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:00:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-568ee79c-9e58-418b-808b-9f67da311444 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.308s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:56 user nova-compute[72178]: INFO nova.compute.manager [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Terminating instance
Aug 01 12:00:56 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-7acce434-a7da-4860-bdf6-6fd6c7ec6a89 req-48bb941f-b62d-4e7d-ac40-347956ebe5c9 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received event network-vif-unplugged-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7acce434-a7da-4860-bdf6-6fd6c7ec6a89 req-48bb941f-b62d-4e7d-ac40-347956ebe5c9 service nova] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7acce434-a7da-4860-bdf6-6fd6c7ec6a89 req-48bb941f-b62d-4e7d-ac40-347956ebe5c9 service nova] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7acce434-a7da-4860-bdf6-6fd6c7ec6a89 req-48bb941f-b62d-4e7d-ac40-347956ebe5c9 service nova] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-7acce434-a7da-4860-bdf6-6fd6c7ec6a89 req-48bb941f-b62d-4e7d-ac40-347956ebe5c9 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] No waiting events found dispatching network-vif-unplugged-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-7acce434-a7da-4860-bdf6-6fd6c7ec6a89 req-48bb941f-b62d-4e7d-ac40-347956ebe5c9 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received event network-vif-unplugged-c4409dd6-d612-428b-b219-fa81b4040453 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Instance destroyed successfully.
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lazy-loading 'resources' on Instance uuid fc8d64a1-321c-45d7-9db3-1159c91ee9b7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1918072023',display_name='tempest-DeleteServersTestJSON-server-1918072023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1918072023',id=4,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f49884dd1641df8bc70177ca60dd1f',ramdisk_id='',reservation_id='r-0feaprwz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-452553089',owner_user_name='tempest-DeleteServersTestJSON-452553089-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T11:59:10Z,user_data=None,user_id='1c33efd008814fd98ce4154b393cf969',uuid=fc8d64a1-321c-45d7-9db3-1159c91ee9b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Converting VIF {"id": "c4409dd6-d612-428b-b219-fa81b4040453", "address": "fa:16:3e:ae:b7:da", "network": {"id": "03c67f25-9337-4fa6-bdcb-54abe38b50ab", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1160407430-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f49884dd1641df8bc70177ca60dd1f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4409dd6-d6", "ovs_interfaceid": "c4409dd6-d612-428b-b219-fa81b4040453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b7:da,bridge_name='br-int',has_traffic_filtering=True,id=c4409dd6-d612-428b-b219-fa81b4040453,network=Network(03c67f25-9337-4fa6-bdcb-54abe38b50ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4409dd6-d6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_vif [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b7:da,bridge_name='br-int',has_traffic_filtering=True,id=c4409dd6-d612-428b-b219-fa81b4040453,network=Network(03c67f25-9337-4fa6-bdcb-54abe38b50ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4409dd6-d6') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4409dd6-d6, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:00:57 user nova-compute[72178]: INFO os_vif [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:b7:da,bridge_name='br-int',has_traffic_filtering=True,id=c4409dd6-d612-428b-b219-fa81b4040453,network=Network(03c67f25-9337-4fa6-bdcb-54abe38b50ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4409dd6-d6')
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'heVGfzLb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:00:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9389b16-2fa2-49a9-8ac6-5f7552ef1814]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff0d29e-319c-4cce-9146-22435b50d5e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:57 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:57 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:00:57 user nova-compute[72178]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 (non-flash)
Aug 01 12:00:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:00:57 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:00:57 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:00:57 user nova-compute[72178]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 (non-flash)
Aug 01 12:00:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd904125b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[db867687-d4dd-44e0-9e8d-f6149fc124b9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[05801fec-fb4d-4746-ba17-44e1d82976af]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d262b14-68b9-4432-a5f9-6d1575359765]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[35df64e9-692e-4b5a-b41b-f69771cebae0]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea5bf27-f8ed-4e5d-8bba-b8998398d65e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a839e852-cae4-44fc-91b0-0af61e6f0f99]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3, portal: 172.16.0.220,3260]
Aug 01 12:00:57 user nova-compute[72178]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3, portal: 172.16.0.220,3260] successful.
Aug 01 12:00:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5d3d99a1-b0ef-404e-83da-203a1fc581b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7842e4-042a-468d-a932-1d4866c57d3d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] <== disconnect_volume: return (297ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:00:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:00:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Deleting instance files /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7_del
Aug 01 12:00:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Deletion of /opt/stack/data/nova/instances/fc8d64a1-321c-45d7-9db3-1159c91ee9b7_del complete
Aug 01 12:00:58 user nova-compute[72178]: INFO nova.compute.manager [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 01 12:00:58 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:00:58 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:00:58 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:00:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:00:58 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-f139152a-e421-40d0-82d1-c12c3b1bf792 req-c06b9c2a-b15d-4958-abb5-3a67b84f7ce1 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received event network-vif-deleted-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:58 user nova-compute[72178]: INFO nova.compute.manager [req-f139152a-e421-40d0-82d1-c12c3b1bf792 req-c06b9c2a-b15d-4958-abb5-3a67b84f7ce1 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Neutron deleted interface c4409dd6-d612-428b-b219-fa81b4040453; detaching it from the instance and deleting it from the info cache
Aug 01 12:00:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-f139152a-e421-40d0-82d1-c12c3b1bf792 req-c06b9c2a-b15d-4958-abb5-3a67b84f7ce1 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:00:58 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Took 0.71 seconds to deallocate network for instance.
Aug 01 12:00:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-f139152a-e421-40d0-82d1-c12c3b1bf792 req-c06b9c2a-b15d-4958-abb5-3a67b84f7ce1 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Detach interface failed, port_id=c4409dd6-d612-428b-b219-fa81b4040453, reason: Instance fc8d64a1-321c-45d7-9db3-1159c91ee9b7 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:00:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec0e67b3-34ab-48e3-aaed-2f713435e104 req-4149a000-e280-4186-9947-119042bcbd00 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received event network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:00:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec0e67b3-34ab-48e3-aaed-2f713435e104 req-4149a000-e280-4186-9947-119042bcbd00 service nova] Acquiring lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec0e67b3-34ab-48e3-aaed-2f713435e104 req-4149a000-e280-4186-9947-119042bcbd00 service nova] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:00:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec0e67b3-34ab-48e3-aaed-2f713435e104 req-4149a000-e280-4186-9947-119042bcbd00 service nova] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:00:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec0e67b3-34ab-48e3-aaed-2f713435e104 req-4149a000-e280-4186-9947-119042bcbd00 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] No waiting events found dispatching network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:00:59 user nova-compute[72178]: WARNING nova.compute.manager [req-ec0e67b3-34ab-48e3-aaed-2f713435e104 req-4149a000-e280-4186-9947-119042bcbd00 service nova] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Received unexpected event network-vif-plugged-c4409dd6-d612-428b-b219-fa81b4040453 for instance with vm_state active and task_state deleting.
Aug 01 12:00:59 user nova-compute[72178]: INFO nova.compute.manager [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Took 0.97 seconds to detach 1 volumes for instance.
Aug 01 12:00:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:00:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:00 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:01:00 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:01:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:00 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Deleted allocations for instance fc8d64a1-321c-45d7-9db3-1159c91ee9b7
Aug 01 12:01:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6e32436e-6e43-4351-913a-42cf5436c4d3 tempest-DeleteServersTestJSON-452553089 tempest-DeleteServersTestJSON-452553089-project-member] Lock "fc8d64a1-321c-45d7-9db3-1159c91ee9b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.659s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:00 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891245.7671106, a378bfa5-d230-4e81-bc4f-16132501f1df => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:01:00 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] VM Stopped (Lifecycle Event)
Aug 01 12:01:00 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ac01cd52-66d0-4503-bbf0-47db2881aacd None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:01:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-4e68c7d0-54ce-49c5-9e70-3de47e9f7c4e req-7b6ef1a6-e2c2-4645-a3f1-19a6a582921a service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received event network-changed-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-4e68c7d0-54ce-49c5-9e70-3de47e9f7c4e req-7b6ef1a6-e2c2-4645-a3f1-19a6a582921a service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Refreshing instance network info cache due to event network-changed-97b9bcbd-4448-4211-a3df-f3e08a41f14e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:01:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4e68c7d0-54ce-49c5-9e70-3de47e9f7c4e req-7b6ef1a6-e2c2-4645-a3f1-19a6a582921a service nova] Acquiring lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:01:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4e68c7d0-54ce-49c5-9e70-3de47e9f7c4e req-7b6ef1a6-e2c2-4645-a3f1-19a6a582921a service nova] Acquired lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:01:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-4e68c7d0-54ce-49c5-9e70-3de47e9f7c4e req-7b6ef1a6-e2c2-4645-a3f1-19a6a582921a service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Refreshing network info cache for port 97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:01:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-4e68c7d0-54ce-49c5-9e70-3de47e9f7c4e req-7b6ef1a6-e2c2-4645-a3f1-19a6a582921a service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Updated VIF entry in instance network info cache for port 97b9bcbd-4448-4211-a3df-f3e08a41f14e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:01:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-4e68c7d0-54ce-49c5-9e70-3de47e9f7c4e req-7b6ef1a6-e2c2-4645-a3f1-19a6a582921a service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Updating instance_info_cache with network_info: [{"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4e68c7d0-54ce-49c5-9e70-3de47e9f7c4e req-7b6ef1a6-e2c2-4645-a3f1-19a6a582921a service nova] Releasing lock "refresh_cache-686d22d8-fae6-4035-aeac-c80cbeaff08b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:01:10 user nova-compute[72178]: INFO nova.compute.claims [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Claim successful on node user
Aug 01 12:01:10 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:01:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.policy [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aea8d3cf69c74eddad04ef8f6010c485', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3c2820314944cba89d45b0d3cd80681', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:01:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Creating image(s)
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "/opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "/opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "/opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk 1073741824" returned: 0 in 0.052s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Cannot resize image /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:01:11 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lazy-loading 'migration_context' on Instance uuid 98d39c47-5233-40b1-8d34-af244719fe52 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Ensure instance console log exists: /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Successfully created port: 3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.objects.instance [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'flavor' on Instance uuid 686d22d8-fae6-4035-aeac-c80cbeaff08b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:12 user nova-compute[72178]: INFO nova.compute.manager [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Attaching volume 6cf2e293-890f-4bd8-abb2-860f2c5b0394 to /dev/vdb
Aug 01 12:01:12 user nova-compute[72178]: DEBUG os_brick.utils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[48936a22-fa0a-475f-b1e6-ce14c01130a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7291131-af34-42bf-82cf-db7d337c8f3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8caca70-0f98-49e2-a423-42095159a07e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dc5a58-a831-4695-bc47-99435cb8fef1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:12 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2491ec6-4d08-41fc-8dbe-3bf48af787ac]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG os_brick.utils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Updating existing volume attachment record: 67b0053d-a250-4299-bfd5-df0dbbfdcaad {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891257.6246202, fc8d64a1-321c-45d7-9db3-1159c91ee9b7 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:01:12 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] VM Stopped (Lifecycle Event)
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-85e0b8fe-6e61-43e2-9d78-6325519c580d None None] [instance: fc8d64a1-321c-45d7-9db3-1159c91ee9b7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Successfully updated port: 3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquired lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-d2dc1e19-3b63-4012-874f-2715aed9019e req-5f9ce554-4e12-4d0d-b3e1-01900590facc service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received event network-changed-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-d2dc1e19-3b63-4012-874f-2715aed9019e req-5f9ce554-4e12-4d0d-b3e1-01900590facc service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Refreshing instance network info cache due to event network-changed-3a03414e-614f-4b71-9eb7-36948736113c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d2dc1e19-3b63-4012-874f-2715aed9019e req-5f9ce554-4e12-4d0d-b3e1-01900590facc service nova] Acquiring lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:01:12 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Updating instance_info_cache with network_info: [{"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Releasing lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Instance network_info: |[{"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d2dc1e19-3b63-4012-874f-2715aed9019e req-5f9ce554-4e12-4d0d-b3e1-01900590facc service nova] Acquired lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.neutron [req-d2dc1e19-3b63-4012-874f-2715aed9019e req-5f9ce554-4e12-4d0d-b3e1-01900590facc service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Refreshing network info cache for port 3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Start _get_guest_xml network_info=[{"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:01:13 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:01:13 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1930793926',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1930793926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1930793',id=13,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKD9XCmKULETf+Sv0lPVOMr8nOSEaM9/lzAmsSF1AiJPJrZAofvryL+aibbfAYaFU2czs+8XjrfFLihPSFaAow9AeuQUxxYYkBpyR3jiiHkQcIjZxplF336PXT6XQdfgQ==',key_name='tempest-keypair-491882663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c2820314944cba89d45b0d3cd80681',ramdisk_id='',reservation_id='r-dpy7m9uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2094198439',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea8d3cf69c74eddad04ef8f6010c485',uuid=98d39c47-5233-40b1-8d34-af244719fe52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Converting VIF {"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:49:3a,bridge_name='br-int',has_traffic_filtering=True,id=3a03414e-614f-4b71-9eb7-36948736113c,network=Network(a79bc6c4-72b8-4607-957a-ab1dcb49b05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03414e-61') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lazy-loading 'pci_devices' on Instance uuid 98d39c47-5233-40b1-8d34-af244719fe52 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:01:13 user nova-compute[72178]:   <uuid>98d39c47-5233-40b1-8d34-af244719fe52</uuid>
Aug 01 12:01:13 user nova-compute[72178]:   <name>instance-0000000d</name>
Aug 01 12:01:13 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:01:13 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:01:13 user nova-compute[72178]:   <metadata>
Aug 01 12:01:13 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:01:13 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:01:13 user nova-compute[72178]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1930793926</nova:name>
Aug 01 12:01:13 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:01:13</nova:creationTime>
Aug 01 12:01:13 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:01:13 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:01:13 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:01:13 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:01:13 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:01:13 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:01:13 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:01:13 user nova-compute[72178]:       <nova:owner>
Aug 01 12:01:13 user nova-compute[72178]:         <nova:user uuid="aea8d3cf69c74eddad04ef8f6010c485">tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member</nova:user>
Aug 01 12:01:13 user nova-compute[72178]:         <nova:project uuid="a3c2820314944cba89d45b0d3cd80681">tempest-TestServerVolumeAttachScenarioOldVersion-2094198439</nova:project>
Aug 01 12:01:13 user nova-compute[72178]:       </nova:owner>
Aug 01 12:01:13 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:01:13 user nova-compute[72178]:       <nova:ports>
Aug 01 12:01:13 user nova-compute[72178]:         <nova:port uuid="3a03414e-614f-4b71-9eb7-36948736113c">
Aug 01 12:01:13 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 12:01:13 user nova-compute[72178]:         </nova:port>
Aug 01 12:01:13 user nova-compute[72178]:       </nova:ports>
Aug 01 12:01:13 user nova-compute[72178]:     </nova:instance>
Aug 01 12:01:13 user nova-compute[72178]:   </metadata>
Aug 01 12:01:13 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:01:13 user nova-compute[72178]:     <system>
Aug 01 12:01:13 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:01:13 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:01:13 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:01:13 user nova-compute[72178]:       <entry name="serial">98d39c47-5233-40b1-8d34-af244719fe52</entry>
Aug 01 12:01:13 user nova-compute[72178]:       <entry name="uuid">98d39c47-5233-40b1-8d34-af244719fe52</entry>
Aug 01 12:01:13 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:01:13 user nova-compute[72178]:     </system>
Aug 01 12:01:13 user nova-compute[72178]:   </sysinfo>
Aug 01 12:01:13 user nova-compute[72178]:   <os>
Aug 01 12:01:13 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:01:13 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:01:13 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:01:13 user nova-compute[72178]:   </os>
Aug 01 12:01:13 user nova-compute[72178]:   <features>
Aug 01 12:01:13 user nova-compute[72178]:     <acpi/>
Aug 01 12:01:13 user nova-compute[72178]:     <apic/>
Aug 01 12:01:13 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:01:13 user nova-compute[72178]:   </features>
Aug 01 12:01:13 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:01:13 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:01:13 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:01:13 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:01:13 user nova-compute[72178]:   </clock>
Aug 01 12:01:13 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:01:13 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:01:13 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:01:13 user nova-compute[72178]:   </cpu>
Aug 01 12:01:13 user nova-compute[72178]:   <devices>
Aug 01 12:01:13 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:01:13 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:01:13 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk"/>
Aug 01 12:01:13 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:01:13 user nova-compute[72178]:     </disk>
Aug 01 12:01:13 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:01:13 user nova-compute[72178]:       <mac address="fa:16:3e:b9:49:3a"/>
Aug 01 12:01:13 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:01:13 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:01:13 user nova-compute[72178]:       <target dev="tap3a03414e-61"/>
Aug 01 12:01:13 user nova-compute[72178]:     </interface>
Aug 01 12:01:13 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:01:13 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/console.log" append="off"/>
Aug 01 12:01:13 user nova-compute[72178]:     </serial>
Aug 01 12:01:13 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:01:13 user nova-compute[72178]:     <video>
Aug 01 12:01:13 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:01:13 user nova-compute[72178]:     </video>
Aug 01 12:01:13 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:01:13 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:01:13 user nova-compute[72178]:     </rng>
Aug 01 12:01:13 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:01:13 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:01:13 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:01:13 user nova-compute[72178]:     </memballoon>
Aug 01 12:01:13 user nova-compute[72178]:   </devices>
Aug 01 12:01:13 user nova-compute[72178]: </domain>
Aug 01 12:01:13 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1930793926',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1930793926',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1930793',id=13,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKD9XCmKULETf+Sv0lPVOMr8nOSEaM9/lzAmsSF1AiJPJrZAofvryL+aibbfAYaFU2czs+8XjrfFLihPSFaAow9AeuQUxxYYkBpyR3jiiHkQcIjZxplF336PXT6XQdfgQ==',key_name='tempest-keypair-491882663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3c2820314944cba89d45b0d3cd80681',ramdisk_id='',reservation_id='r-dpy7m9uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2094198439',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea8d3cf69c74eddad04ef8f6010c485',uuid=98d39c47-5233-40b1-8d34-af244719fe52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Converting VIF {"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:49:3a,bridge_name='br-int',has_traffic_filtering=True,id=3a03414e-614f-4b71-9eb7-36948736113c,network=Network(a79bc6c4-72b8-4607-957a-ab1dcb49b05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03414e-61') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG os_vif [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:49:3a,bridge_name='br-int',has_traffic_filtering=True,id=3a03414e-614f-4b71-9eb7-36948736113c,network=Network(a79bc6c4-72b8-4607-957a-ab1dcb49b05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03414e-61') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a03414e-61, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a03414e-61, col_values=(('external_ids', {'iface-id': '3a03414e-614f-4b71-9eb7-36948736113c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:49:3a', 'vm-uuid': '98d39c47-5233-40b1-8d34-af244719fe52'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:13 user nova-compute[72178]: INFO os_vif [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:49:3a,bridge_name='br-int',has_traffic_filtering=True,id=3a03414e-614f-4b71-9eb7-36948736113c,network=Network(a79bc6c4-72b8-4607-957a-ab1dcb49b05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03414e-61')
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] No VIF found with MAC fa:16:3e:b9:49:3a, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-a03e044b-d57e-4910-b649-41380e8478b1 req-2cfd014c-3903-4b68-9992-94b3763161c0 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received event network-changed-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-a03e044b-d57e-4910-b649-41380e8478b1 req-2cfd014c-3903-4b68-9992-94b3763161c0 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Refreshing instance network info cache due to event network-changed-ce5af459-034f-4974-8020-e351fea55ce2. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a03e044b-d57e-4910-b649-41380e8478b1 req-2cfd014c-3903-4b68-9992-94b3763161c0 service nova] Acquiring lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a03e044b-d57e-4910-b649-41380e8478b1 req-2cfd014c-3903-4b68-9992-94b3763161c0 service nova] Acquired lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.neutron [req-a03e044b-d57e-4910-b649-41380e8478b1 req-2cfd014c-3903-4b68-9992-94b3763161c0 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Refreshing network info cache for port ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.neutron [req-d2dc1e19-3b63-4012-874f-2715aed9019e req-5f9ce554-4e12-4d0d-b3e1-01900590facc service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Updated VIF entry in instance network info cache for port 3a03414e-614f-4b71-9eb7-36948736113c. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG nova.network.neutron [req-d2dc1e19-3b63-4012-874f-2715aed9019e req-5f9ce554-4e12-4d0d-b3e1-01900590facc service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Updating instance_info_cache with network_info: [{"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d2dc1e19-3b63-4012-874f-2715aed9019e req-5f9ce554-4e12-4d0d-b3e1-01900590facc service nova] Releasing lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG nova.objects.instance [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lazy-loading 'flavor' on Instance uuid ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:14 user nova-compute[72178]: INFO nova.compute.manager [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Attaching volume 702aba5d-32d4-47c1-8cf2-edbed380b1b6 to /dev/vdb
Aug 01 12:01:14 user nova-compute[72178]: DEBUG os_brick.utils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG nova.network.neutron [req-a03e044b-d57e-4910-b649-41380e8478b1 req-2cfd014c-3903-4b68-9992-94b3763161c0 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Updated VIF entry in instance network info cache for port ce5af459-034f-4974-8020-e351fea55ce2. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG nova.network.neutron [req-a03e044b-d57e-4910-b649-41380e8478b1 req-2cfd014c-3903-4b68-9992-94b3763161c0 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Updating instance_info_cache with network_info: [{"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df5c705-adf1-41dc-8be2-6c9ab2a4a2eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a03e044b-d57e-4910-b649-41380e8478b1 req-2cfd014c-3903-4b68-9992-94b3763161c0 service nova] Releasing lock "refresh_cache-ddde3963-45a3-4c13-9a58-134d87babeaf" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95d30f7-3257-40d5-8320-f4cc534a30e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b40e40-a670-417e-aa10-e217f136249f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8661e524-4181-49f0-ad29-5cad60fb880d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:14 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:01:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94178c7-ad1b-4064-bb0a-0de19b530847]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG os_brick.utils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Updating existing volume attachment record: ccd94dff-adb3-40a4-9627-3c7e8f8045d1 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-abdaad08-17ae-412f-918b-a5fb2419a3de req-4dce6b13-c65b-4889-8945-5a8632d51942 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received event network-changed-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-abdaad08-17ae-412f-918b-a5fb2419a3de req-4dce6b13-c65b-4889-8945-5a8632d51942 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Refreshing instance network info cache due to event network-changed-cbd56403-d002-4dcd-af14-633cad3cb080. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-abdaad08-17ae-412f-918b-a5fb2419a3de req-4dce6b13-c65b-4889-8945-5a8632d51942 service nova] Acquiring lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-abdaad08-17ae-412f-918b-a5fb2419a3de req-4dce6b13-c65b-4889-8945-5a8632d51942 service nova] Acquired lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.network.neutron [req-abdaad08-17ae-412f-918b-a5fb2419a3de req-4dce6b13-c65b-4889-8945-5a8632d51942 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Refreshing network info cache for port cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.network.neutron [req-abdaad08-17ae-412f-918b-a5fb2419a3de req-4dce6b13-c65b-4889-8945-5a8632d51942 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Updated VIF entry in instance network info cache for port cbd56403-d002-4dcd-af14-633cad3cb080. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.network.neutron [req-abdaad08-17ae-412f-918b-a5fb2419a3de req-4dce6b13-c65b-4889-8945-5a8632d51942 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Updating instance_info_cache with network_info: [{"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received event network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] No waiting events found dispatching network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:01:15 user nova-compute[72178]: WARNING nova.compute.manager [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received unexpected event network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c for instance with vm_state building and task_state spawning.
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received event network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] No waiting events found dispatching network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:01:15 user nova-compute[72178]: WARNING nova.compute.manager [req-fd37f029-a733-4ad0-86f6-a08809d95d4d req-c593ccaf-5d70-490d-a7d4-4074f3198244 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received unexpected event network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c for instance with vm_state building and task_state spawning.
Aug 01 12:01:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-abdaad08-17ae-412f-918b-a5fb2419a3de req-4dce6b13-c65b-4889-8945-5a8632d51942 service nova] Releasing lock "refresh_cache-249a69cd-ce20-4613-862d-ec31fa6669e5" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:01:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891277.2160525, 98d39c47-5233-40b1-8d34-af244719fe52 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:01:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] VM Resumed (Lifecycle Event)
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:01:17 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Instance spawned successfully.
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:01:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891277.2163239, 98d39c47-5233-40b1-8d34-af244719fe52 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:01:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] VM Started (Lifecycle Event)
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:01:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:01:17 user nova-compute[72178]: INFO nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 01 12:01:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:01:17 user nova-compute[72178]: INFO nova.compute.manager [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Took 7.11 seconds to build instance.
Aug 01 12:01:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d56f51ea-5cfd-42a3-9bb0-54de3ef51167 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.210s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG nova.objects.instance [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lazy-loading 'flavor' on Instance uuid 249a69cd-ce20-4613-862d-ec31fa6669e5 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:19 user nova-compute[72178]: INFO nova.compute.manager [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Attaching volume 47fe1a49-0f00-4673-aaa5-c98425fead04 to /dev/sdc
Aug 01 12:01:19 user nova-compute[72178]: DEBUG os_brick.utils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd7a6b8-f1e7-4cf2-a736-7b213bb88103]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18ce85e-a3b3-4777-bfe1-68b2c142188e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2042456e-d94a-4ba3-885b-97732a51a486]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72ededd-f7f3-410b-99d9-a3b00f5866ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:19 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:01:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b696d-7ab9-4ea3-ba1c-9200333e33b9]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG os_brick.utils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:19 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Updating existing volume attachment record: 2f602c4d-91c7-49fc-9180-f4072233b3ee {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CeKqjQFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:20 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:20 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:20 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[babc1089-b516-4670-b8b1-c25cae11627b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:01:20 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcf7602-bbbf-4336-a88e-18dc2b496a4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394] added
Aug 01 12:01:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c1fa70-7b39-4e22-89b3-0f4fdf87d61f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15bc9c3-7df6-4e1c-8664-19e69c5983b1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CeKqjQFB {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CeKqjQFB" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[796656c9-7a1e-4ee5-a5de-9fdc7f4f2367]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CeKqjQFB'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2adecde-d357-4231-8d39-2d9b373670c5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b263f4-bba2-4f5c-b9be-9aec23ee6860]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:20 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:20 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:20 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:20 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfbfa6a-2167-46f1-94fc-9daa72643ea9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394, portal: 172.16.0.220,3260]
Aug 01 12:01:20 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72f723-1c54-4ef9-8592-4da0f0f72aa8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb48a42-2e2a-41d7-8cfd-59230b05acc6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:21 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:21 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:21 user nova-compute[72178]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)
Aug 01 12:01:21 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:21 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:21 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:21 user nova-compute[72178]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)
Aug 01 12:01:21 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fa4198-2d97-4c7b-990d-d3e2842ead56]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CeKqjQFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:01:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23931623634653962', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931623634653962', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG nova.objects.instance [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'flavor' on Instance uuid 686d22d8-fae6-4035-aeac-c80cbeaff08b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:01:22 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:22 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:01:22 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:01:22 user nova-compute[72178]:   <serial>6cf2e293-890f-4bd8-abb2-860f2c5b0394</serial>
Aug 01 12:01:22 user nova-compute[72178]: </disk>
Aug 01 12:01:22 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] No VIF found with MAC fa:16:3e:66:64:12, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:22 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:22 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:22 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ce0c6e-d7f4-47d5-9ebc-6d6f8c1b493b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:01:22 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e554e-9914-44e6-b8e9-fc105fc5194e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6] added
Aug 01 12:01:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a8bdde-b9b4-4aec-96d9-ebf81b2699db]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdaff43-88b8-4b23-a505-f5c2a4291aeb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-69cb7cd6-4d38-4303-8280-e79984ebeafb tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.373s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UeRcklsI {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UeRcklsI" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a893393-90ac-4a29-955f-997f7700a44f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UeRcklsI'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaae6838-ddb1-45ad-880a-25cec702339e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644b5bd-afbf-4fb7-a8fa-8893f7eab35e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d120ff-d4ca-41a4-a9b0-0397027a399c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260]
Aug 01 12:01:22 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8081fe44-8638-4084-b718-34ffeb0f2df1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5daca1f-d91f-489f-bece-43f4f65b0c1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c328ff1-00f2-4fc4-82da-16af37d6a11e]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:01:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:01:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:23 user nova-compute[72178]: INFO nova.compute.manager [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Detaching volume 6cf2e293-890f-4bd8-abb2-860f2c5b0394
Aug 01 12:01:23 user nova-compute[72178]: INFO nova.virt.block_device [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Attempting to driver detach volume 6cf2e293-890f-4bd8-abb2-860f2c5b0394 from mountpoint /dev/vdb
Aug 01 12:01:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Attempting to detach device vdb from instance 686d22d8-fae6-4035-aeac-c80cbeaff08b from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:01:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:01:23 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:23 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:01:23 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:01:23 user nova-compute[72178]:   <serial>6cf2e293-890f-4bd8-abb2-860f2c5b0394</serial>
Aug 01 12:01:23 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:01:23 user nova-compute[72178]: </disk>
Aug 01 12:01:23 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:01:23 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Successfully detached device vdb from instance 686d22d8-fae6-4035-aeac-c80cbeaff08b from the persistent domain config.
Aug 01 12:01:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 686d22d8-fae6-4035-aeac-c80cbeaff08b from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:01:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:01:23 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:23 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:01:23 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:01:23 user nova-compute[72178]:   <serial>6cf2e293-890f-4bd8-abb2-860f2c5b0394</serial>
Aug 01 12:01:23 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:01:23 user nova-compute[72178]: </disk>
Aug 01 12:01:23 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23031363938316562', 'path': '/dev/sdf'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031363938316562', 'path': '/dev/sdf'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lazy-loading 'flavor' on Instance uuid ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:01:24 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:24 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:01:24 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:01:24 user nova-compute[72178]:   <serial>702aba5d-32d4-47c1-8cf2-edbed380b1b6</serial>
Aug 01 12:01:24 user nova-compute[72178]: </disk>
Aug 01 12:01:24 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891284.3434236, 686d22d8-fae6-4035-aeac-c80cbeaff08b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 686d22d8-fae6-4035-aeac-c80cbeaff08b {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Successfully detached device vdb from instance 686d22d8-fae6-4035-aeac-c80cbeaff08b from the live domain config.
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CeKqjQFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:24 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f0c721-277a-4c24-a216-c0c99ad0783d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24e5509-5a91-4c09-a86f-6c364e9e5779]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:24 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:24 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:24 user nova-compute[72178]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)
Aug 01 12:01:24 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:24 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:24 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:24 user nova-compute[72178]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 (non-flash)
Aug 01 12:01:24 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f461b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e498cff-31e7-4430-8ecb-5bbb461b9734]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b35c736-4351-4a46-9f4b-ea36efdf0b76]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1dbfa3-1fc2-4698-9f8a-643816e31579]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[88470e86-10a1-485e-a79e-d5d159f0fa53]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f18e24-2c6b-447f-b703-fc9f054ab23e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --logout" returned: 0 in 0.216s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[468dd35e-d832-4757-90c2-77a93910a5c9]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394, portal: 172.16.0.220,3260]
Aug 01 12:01:24 user nova-compute[72178]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf2e293-890f-4bd8-abb2-860f2c5b0394 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1788aee7-638d-495d-bb09-06c85a23102b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.462s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] <== disconnect_volume: return (463ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:01:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] No VIF found with MAC fa:16:3e:13:f6:86, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:01:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cc8b8d2e-2b50-4114-9e81-0684a7d2e9d9 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.964s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:01:25 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'flavor' on Instance uuid 686d22d8-fae6-4035-aeac-c80cbeaff08b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7e394547-42d5-4797-892f-0319e2ffdc1d tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.938s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG os_brick.utils [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0730df9a-8f7b-47ba-8e85-0f7b6da74e41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d34591-7dc3-4222-b63b-1d803851d95f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeee0dc-756a-4035-a7ea-0c2f257478ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5299ee8-2c99-4552-8667-1807da84496a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:26 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:01:26 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[476379d2-15aa-42cf-a60c-2aac048e1fff]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG os_brick.utils [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:26 user nova-compute[72178]: INFO nova.compute.manager [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Swapping volume 702aba5d-32d4-47c1-8cf2-edbed380b1b6 for 36d04d53-1b62-4e33-87ca-83df3c802d04
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vprzjVZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:27 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:27 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:27 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e0fe01-4327-4cbe-b8e9-5c5e74bf09b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:01:27 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c661c4-9c9c-4bef-a68b-bfb84715cb43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04] added
Aug 01 12:01:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebe400f-223e-4f38-a6dc-796de8734e23]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d7dd77-8f24-42d2-9067-f07918a57105]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vprzjVZD {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vprzjVZD" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4968abf-66a4-41b3-978c-e3ae334a6a56]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vprzjVZD'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[04999241-b023-4247-abb8-7c0ce3eb720b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[591c3bf6-eb58-40a7-8722-cc1a4efd8807]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26bea03-c566-478c-8a5a-9ae55aef020b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04, portal: 172.16.0.220,3260]
Aug 01 12:01:27 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefdc73d-456b-44fb-a7b7-ed4cc05a6c74]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1f40d3-8151-4143-b94f-2aa4401478f9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 (non-flash)
Aug 01 12:01:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5479b3d4-e6c9-4e1a-aba8-f6bdbc932b6d]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:01:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vprzjVZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23030636434393538', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030636434393538', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG nova.objects.instance [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lazy-loading 'flavor' on Instance uuid 249a69cd-ce20-4613-862d-ec31fa6669e5 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:01:28 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:28 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:01:28 user nova-compute[72178]:   <target dev="sdc" bus="scsi"/>
Aug 01 12:01:28 user nova-compute[72178]:   <serial>47fe1a49-0f00-4673-aaa5-c98425fead04</serial>
Aug 01 12:01:28 user nova-compute[72178]:   <address type="drive" controller="0" unit="2"/>
Aug 01 12:01:28 user nova-compute[72178]: </disk>
Aug 01 12:01:28 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:01:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] No BDM found with device name sda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] No VIF found with MAC fa:16:3e:f1:52:e1, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aaaca74d-c1a7-413a-828b-1610a3f3234c tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.479s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:31 user nova-compute[72178]: INFO nova.compute.manager [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Detaching volume 47fe1a49-0f00-4673-aaa5-c98425fead04
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: INFO nova.virt.block_device [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Attempting to driver detach volume 47fe1a49-0f00-4673-aaa5-c98425fead04 from mountpoint /dev/sdc
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Attempting to detach device sdc from instance 249a69cd-ce20-4613-862d-ec31fa6669e5 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:01:31 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:31 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:01:31 user nova-compute[72178]:   <target dev="sdc" bus="scsi"/>
Aug 01 12:01:31 user nova-compute[72178]:   <serial>47fe1a49-0f00-4673-aaa5-c98425fead04</serial>
Aug 01 12:01:31 user nova-compute[72178]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 12:01:31 user nova-compute[72178]: </disk>
Aug 01 12:01:31 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:01:31 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Successfully detached device sdc from instance 249a69cd-ce20-4613-862d-ec31fa6669e5 from the persistent domain config.
Aug 01 12:01:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 249a69cd-ce20-4613-862d-ec31fa6669e5 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:01:31 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:31 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:01:31 user nova-compute[72178]:   <target dev="sdc" bus="scsi"/>
Aug 01 12:01:31 user nova-compute[72178]:   <serial>47fe1a49-0f00-4673-aaa5-c98425fead04</serial>
Aug 01 12:01:31 user nova-compute[72178]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 01 12:01:31 user nova-compute[72178]: </disk>
Aug 01 12:01:31 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891291.783796, 249a69cd-ce20-4613-862d-ec31fa6669e5 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 249a69cd-ce20-4613-862d-ec31fa6669e5 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:01:31 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Successfully detached device sdc from instance 249a69cd-ce20-4613-862d-ec31fa6669e5 from the live domain config.
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vprzjVZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:31 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb9a5d3-a337-4a8b-8aa8-4050b6a00677]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae1cddb-163e-4fc2-a067-3a9449e9579d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:31 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:31 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:31 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:31 user nova-compute[72178]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 (non-flash)
Aug 01 12:01:31 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:31 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:31 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:31 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:31 user nova-compute[72178]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 (non-flash)
Aug 01 12:01:31 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f41d7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd75be-08f3-44b2-ab74-80bcbcfb7cbb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[12debba0-aa52-4cc1-a725-efefbb98fc10]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe40d80-14b2-4bfa-bd4a-545c50308daa]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:01:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c925c706-1d6c-4f5b-b4eb-8339b6211a5e]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81e6aa8-8ded-4382-aaae-0dd393bba75d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2868ed60-93ec-409f-b5f3-b60372ea1350]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04, portal: 172.16.0.220,3260]
Aug 01 12:01:32 user nova-compute[72178]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:32 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:01:32 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=6657MB free_disk=25.528881072998047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47fe1a49-0f00-4673-aaa5-c98425fead04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[315950df-1694-4d0a-be47-06e3c5ca1da5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.810s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] <== disconnect_volume: return (813ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 686d22d8-fae6-4035-aeac-c80cbeaff08b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance ddde3963-45a3-4c13-9a58-134d87babeaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 249a69cd-ce20-4613-862d-ec31fa6669e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 2ff02938-0f05-40d9-a1b2-f916818da57c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 98d39c47-5233-40b1-8d34-af244719fe52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:01:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lazy-loading 'flavor' on Instance uuid 249a69cd-ce20-4613-862d-ec31fa6669e5 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7682dca1-5c8c-4383-9407-1901a65167a4 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.412s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:33 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:34 user nova-compute[72178]: INFO nova.compute.manager [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Terminating instance
Aug 01 12:01:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-710ff72d-d58c-44f8-b15b-510365ea564b req-1115f437-89ec-46e7-b266-8d0b26bf2e46 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received event network-vif-unplugged-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-710ff72d-d58c-44f8-b15b-510365ea564b req-1115f437-89ec-46e7-b266-8d0b26bf2e46 service nova] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-710ff72d-d58c-44f8-b15b-510365ea564b req-1115f437-89ec-46e7-b266-8d0b26bf2e46 service nova] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-710ff72d-d58c-44f8-b15b-510365ea564b req-1115f437-89ec-46e7-b266-8d0b26bf2e46 service nova] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-710ff72d-d58c-44f8-b15b-510365ea564b req-1115f437-89ec-46e7-b266-8d0b26bf2e46 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] No waiting events found dispatching network-vif-unplugged-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-710ff72d-d58c-44f8-b15b-510365ea564b req-1115f437-89ec-46e7-b266-8d0b26bf2e46 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received event network-vif-unplugged-cbd56403-d002-4dcd-af14-633cad3cb080 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvhWZEGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ddde3963-45a3-4c13-9a58-134d87babeaf', 'attached_at': '', 'detached_at': '', 'volume_id': '36d04d53-1b62-4e33-87ca-83df3c802d04', 'serial': '36d04d53-1b62-4e33-87ca-83df3c802d04'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ddde3963-45a3-4c13-9a58-134d87babeaf', 'attached_at': '', 'detached_at': '', 'volume_id': '702aba5d-32d4-47c1-8cf2-edbed380b1b6', 'serial'} {{(pid=72178) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvhWZEGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:35 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:35 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:35 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e879d2-352f-4b56-88de-94d027cc73d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:01:35 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b86a94b-f205-4422-b561-c07a4ce57557]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04] added
Aug 01 12:01:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6570c6-b73b-4e7c-942a-d5705f736d2f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[359a8e6a-3a08-4d40-aec9-358a91fda1f8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvhWZEGe {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvhWZEGe" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[257867be-a0e8-4cc0-8a88-c90ad84a15dd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvhWZEGe'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66ed004-f154-49e0-ab73-4905f76e1ce4]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece6b5b7-3bc4-43a9-ac1e-8e5c9c45a24d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Instance destroyed successfully.
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lazy-loading 'resources' on Instance uuid 249a69cd-ce20-4613-862d-ec31fa6669e5 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T11:59:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-178851496',display_name='tempest-AttachSCSIVolumeTestJSON-server-178851496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-178851496',id=11,image_ref='87df66e6-21ec-470e-af46-e832c5aad99a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMm3XkSaKrT+a3F9H5nshySpm383LZREarF9qoYV4j+J/92Bddk3lNHWKOXTKd+D57VsEC36lbfUC5jO2qFbnLKUlkhNwuvDL5g6DnZm6b6qtDhTVx2V/cqF9PQT1ytgug==',key_name='tempest-keypair-257326513',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5de9ff3ea9745a198b1148bba97015b',ramdisk_id='',reservation_id='r-v0iql086',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='87df66e6-21ec-470e-af46-e832c5aad99a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-130969736',owner_user_name='tempest-AttachSCSIVolumeTestJSON-130969736-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T11:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e3c0d10106a430c965b3c3f86d473f0',uuid=249a69cd-ce20-4613-862d-ec31fa6669e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Converting VIF {"id": "cbd56403-d002-4dcd-af14-633cad3cb080", "address": "fa:16:3e:f1:52:e1", "network": {"id": "e2e17890-d806-4dd3-b7a4-8d27e62636b4", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1983316146-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5de9ff3ea9745a198b1148bba97015b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd56403-d0", "ovs_interfaceid": "cbd56403-d002-4dcd-af14-633cad3cb080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=cbd56403-d002-4dcd-af14-633cad3cb080,network=Network(e2e17890-d806-4dd3-b7a4-8d27e62636b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd56403-d0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_vif [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=cbd56403-d002-4dcd-af14-633cad3cb080,network=Network(e2e17890-d806-4dd3-b7a4-8d27e62636b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd56403-d0') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbd56403-d0, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:35 user nova-compute[72178]: INFO os_vif [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:52:e1,bridge_name='br-int',has_traffic_filtering=True,id=cbd56403-d002-4dcd-af14-633cad3cb080,network=Network(e2e17890-d806-4dd3-b7a4-8d27e62636b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd56403-d0')
Aug 01 12:01:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Deleting instance files /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5_del
Aug 01 12:01:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Deletion of /opt/stack/data/nova/instances/249a69cd-ce20-4613-862d-ec31fa6669e5_del complete
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8a77cc-3085-4a62-9059-09852074d817]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04, portal: 172.16.0.220,3260]
Aug 01 12:01:35 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76a7a0d-187d-4d7f-9a0a-d66aa4962a8d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: INFO nova.compute.manager [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be4e533-d224-4af4-a948-cbc493770701]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713fd4d-e67a-4789-b46b-c2952cf9361e]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:01:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvhWZEGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:36 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Took 0.92 seconds to deallocate network for instance.
Aug 01 12:01:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e3b6285-3614-468b-93fa-0f21c2b1fc5c req-a8e4cdee-2f7c-49ee-bb87-42c18e97d410 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received event network-vif-deleted-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:36 user nova-compute[72178]: INFO nova.compute.manager [req-2e3b6285-3614-468b-93fa-0f21c2b1fc5c req-a8e4cdee-2f7c-49ee-bb87-42c18e97d410 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Neutron deleted interface cbd56403-d002-4dcd-af14-633cad3cb080; detaching it from the instance and deleting it from the info cache
Aug 01 12:01:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-2e3b6285-3614-468b-93fa-0f21c2b1fc5c req-a8e4cdee-2f7c-49ee-bb87-42c18e97d410 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e3b6285-3614-468b-93fa-0f21c2b1fc5c req-a8e4cdee-2f7c-49ee-bb87-42c18e97d410 service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Detach interface failed, port_id=cbd56403-d002-4dcd-af14-633cad3cb080, reason: Instance 249a69cd-ce20-4613-862d-ec31fa6669e5 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26331666538616634', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331666538616634', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lazy-loading 'flavor' on Instance uuid ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:01:36 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:01:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:37 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Deleted allocations for instance 249a69cd-ce20-4613-862d-ec31fa6669e5
Aug 01 12:01:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1e8b3828-f200-4c23-98aa-5cd53c60ff74 tempest-AttachSCSIVolumeTestJSON-130969736 tempest-AttachSCSIVolumeTestJSON-130969736-project-member] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.516s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-796c8278-d3e1-4963-9794-5f5dfe24b928 req-424cd8bd-d7db-42a4-874d-eaf89f4d3ebf service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received event network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-796c8278-d3e1-4963-9794-5f5dfe24b928 req-424cd8bd-d7db-42a4-874d-eaf89f4d3ebf service nova] Acquiring lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-796c8278-d3e1-4963-9794-5f5dfe24b928 req-424cd8bd-d7db-42a4-874d-eaf89f4d3ebf service nova] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-796c8278-d3e1-4963-9794-5f5dfe24b928 req-424cd8bd-d7db-42a4-874d-eaf89f4d3ebf service nova] Lock "249a69cd-ce20-4613-862d-ec31fa6669e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-796c8278-d3e1-4963-9794-5f5dfe24b928 req-424cd8bd-d7db-42a4-874d-eaf89f4d3ebf service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] No waiting events found dispatching network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:01:37 user nova-compute[72178]: WARNING nova.compute.manager [req-796c8278-d3e1-4963-9794-5f5dfe24b928 req-424cd8bd-d7db-42a4-874d-eaf89f4d3ebf service nova] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Received unexpected event network-vif-plugged-cbd56403-d002-4dcd-af14-633cad3cb080 for instance with vm_state deleted and task_state None.
Aug 01 12:01:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 147849216 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 321912832 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 446693376 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 725614592 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 851443712 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 1011875840 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:41 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b985c7f-2a55-442c-9ec4-cd823a8799df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a5862-c3ec-45f0-b5af-73476a97dea2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:41 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:41 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:41 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:41 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:41 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:41 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:41 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:41 user nova-compute[72178]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:41 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:41 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9042525f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'): ({'sdf'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Removing single pathed devices sdf {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2d7e9d-4d42-48e9-bb2d-47425b11e761]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a324aa5-a18c-404e-8146-3216242a2d81]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Flushing IO for device /dev/sdf {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.011s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[62015401-1947-4324-9c94-dfaf63547f8d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffad5b8-efb9-49cd-bfa1-945c588fb2cb]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd512c9a-d983-40e3-9183-8803e9113f9e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[218ce91b-f936-413b-9a9a-06b9453d2562]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260]
Aug 01 12:01:41 user nova-compute[72178]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:41 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dd5a02-ce89-4d61-b3dd-5b9bfcd8a0e7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] <== disconnect_volume: return (287ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvhWZEGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ddde3963-45a3-4c13-9a58-134d87babeaf', 'attached_at': '', 'detached_at': '', 'volume_id': '36d04d53-1b62-4e33-87ca-83df3c802d04', 'serial'} {{(pid=72178) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] swap_volume: removing Cinder connection for volume 702aba5d-32d4-47c1-8cf2-edbed380b1b6 {{(pid=72178) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 12:01:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] swap_volume: Updating volume 702aba5d-32d4-47c1-8cf2-edbed380b1b6 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "HvhWZEGe", "auth_password": "qZtiYlmBoI4OvT", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "36d04d53-1b62-4e33-87ca-83df3c802d04"}, "status": "reserved", "instance": "ddde3963-45a3-4c13-9a58-134d87babeaf", "attached_at": "", "detached_at": "", "volume_id": "36d04d53-1b62-4e33-87ca-83df3c802d04", "serial": "36d04d53-1b62-4e33-87ca-83df3c802d04"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '36d04d53-1b62-4e33-87ca-83df3c802d04', 'no_device': None, 'attachment_id': '82f44efe-5952-4353-a921-c5efd1b2b377'} {{(pid=72178) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 12:01:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a9d8bb4-1807-4f6d-bbb0-057cb91166c3 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.765s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG os_brick.utils [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed9ae83-a06c-403f-845d-422149b1c1c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9c0266-2981-4c16-9329-87d33edee8c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb30a81-6034-4fe4-8ecd-ff92deec0e62]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc23c75-d5bf-4a9f-a81b-47bc714d74c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:43 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:01:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17e1697-a0c2-4750-8562-db60aee50175]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:01:43 user nova-compute[72178]: DEBUG os_brick.utils [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:43 user nova-compute[72178]: INFO nova.compute.manager [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Swapping volume 36d04d53-1b62-4e33-87ca-83df3c802d04 for 702aba5d-32d4-47c1-8cf2-edbed380b1b6
Aug 01 12:01:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891295.5449162, 249a69cd-ce20-4613-862d-ec31fa6669e5 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:01:50 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] VM Stopped (Lifecycle Event)
Aug 01 12:01:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-5ebb2984-9d60-4a9a-b1d8-5faa9aff4d8a None None] [instance: 249a69cd-ce20-4613-862d-ec31fa6669e5] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ddde3963-45a3-4c13-9a58-134d87babeaf', 'attached_at': '', 'detached_at': '', 'volume_id': '702aba5d-32d4-47c1-8cf2-edbed380b1b6', 'serial': '702aba5d-32d4-47c1-8cf2-edbed380b1b6'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvhWZEGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '36d04d53-1b62-4e33-87ca-83df3c802d04'}, 'status': 'reserved', 'instance': 'ddde3963-45a3-4c13-9a58-134d87babeaf', 'attached_at': '', 'detached_at': '', 'volume_id': '36d04d53-1b62-4e33-87ca-83df3c802d04', 'serial'} {{(pid=72178) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:50 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:50 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:50 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[378c750e-b9b9-4fc5-b631-a3d26ca8173d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:01:50 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[56275f99-c305-4506-bcc8-66e7009d89b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6] added
Aug 01 12:01:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a144da19-2a2a-48ce-a2a3-6f00af64b678]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dd7e17-f1e8-48f8-a95c-cfff486180f8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UeRcklsI {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UeRcklsI" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d08bc-05df-4d31-9097-8b4b789ad701]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UeRcklsI'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b35b590-4eb9-4c5e-91d4-e6cffad6df14]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a98e63e-c504-4ae1-a730-de314953e903]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c6bae2-8c8c-4a52-9062-5ea483bae2ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260]
Aug 01 12:01:51 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb25ea78-74b4-45d9-baba-5626c32d4700]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3835a52-b511-41d7-9925-894a9ca9a498]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a33863-3332-486d-af81-335d0aafc59c]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:51 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23031363938316562', 'path': '/dev/sdf'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031363938316562', 'path': '/dev/sdf'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lazy-loading 'flavor' on Instance uuid ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:01:52 user nova-compute[72178]: INFO nova.compute.claims [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Claim successful on node user
Aug 01 12:01:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 163577856 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:53 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:01:53 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:01:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:01:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 326107136 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:01:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:01:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:01:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:01:53 user nova-compute[72178]: INFO nova.virt.block_device [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Booting with blank volume at /dev/vda
Aug 01 12:01:54 user nova-compute[72178]: DEBUG nova.policy [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec0992e3a27a4a44922268a46b27ad83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2fc3212d24561b0b971241fe367ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:01:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 492830720 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Successfully created port: b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:01:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 958398464 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Successfully updated port: b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquired lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-0d1e1008-ba02-4e77-bc8c-225de8398ecf req-556941c8-aaa5-4824-b26b-5ad665327895 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-changed-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-0d1e1008-ba02-4e77-bc8c-225de8398ecf req-556941c8-aaa5-4824-b26b-5ad665327895 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Refreshing instance network info cache due to event network-changed-b7d6253a-cf03-47ad-8398-2a9c13e58116. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0d1e1008-ba02-4e77-bc8c-225de8398ecf req-556941c8-aaa5-4824-b26b-5ad665327895 service nova] Acquiring lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvhWZEGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '36d04d53-1b62-4e33-87ca-83df3c802d04'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:56 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6798898-88b1-4f5e-bede-7feee4c9305d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[add53063-4d21-409e-a728-e9d7ef97f382]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:56 user nova-compute[72178]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:56 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:56 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:56 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:56 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:56 user nova-compute[72178]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:56 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:56 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:56 user nova-compute[72178]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 (non-flash)
Aug 01 12:01:56 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9017bc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updating instance_info_cache with network_info: [{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[baacb44c-89d1-4395-bcc9-55a044be56a2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Releasing lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance network_info: |[{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0d1e1008-ba02-4e77-bc8c-225de8398ecf req-556941c8-aaa5-4824-b26b-5ad665327895 service nova] Acquired lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:01:56 user nova-compute[72178]: DEBUG nova.network.neutron [req-0d1e1008-ba02-4e77-bc8c-225de8398ecf req-556941c8-aaa5-4824-b26b-5ad665327895 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Refreshing network info cache for port b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb1f2c-7d54-4748-a9d3-e8da6801f1f3]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c0988-bc60-477e-a736-06e1aa96fb36]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1396fe06-de4e-419f-b300-1e502b938bed]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[73088b03-3a50-4496-b8fc-3f6eb1a3aa60]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a470cf4a-cda3-40ba-8762-cc3d7924ecb5]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04, portal: 172.16.0.220,3260]
Aug 01 12:01:57 user nova-compute[72178]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:36d04d53-1b62-4e33-87ca-83df3c802d04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64dec65-00a6-45d8-a54c-ee2498c14147]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] <== disconnect_volume: return (325ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ddde3963-45a3-4c13-9a58-134d87babeaf', 'attached_at': '', 'detached_at': '', 'volume_id': '702aba5d-32d4-47c1-8cf2-edbed380b1b6', 'serial'} {{(pid=72178) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] swap_volume: removing Cinder connection for volume 36d04d53-1b62-4e33-87ca-83df3c802d04 {{(pid=72178) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-0d1e1008-ba02-4e77-bc8c-225de8398ecf req-556941c8-aaa5-4824-b26b-5ad665327895 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updated VIF entry in instance network info cache for port b7d6253a-cf03-47ad-8398-2a9c13e58116. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-0d1e1008-ba02-4e77-bc8c-225de8398ecf req-556941c8-aaa5-4824-b26b-5ad665327895 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updating instance_info_cache with network_info: [{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:01:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0d1e1008-ba02-4e77-bc8c-225de8398ecf req-556941c8-aaa5-4824-b26b-5ad665327895 service nova] Releasing lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:01:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] swap_volume: Updating volume 36d04d53-1b62-4e33-87ca-83df3c802d04 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "UeRcklsI", "auth_password": "Z6og7ADYnijwN2", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "702aba5d-32d4-47c1-8cf2-edbed380b1b6"}, "status": "reserved", "instance": "ddde3963-45a3-4c13-9a58-134d87babeaf", "attached_at": "", "detached_at": "", "volume_id": "702aba5d-32d4-47c1-8cf2-edbed380b1b6", "serial": "702aba5d-32d4-47c1-8cf2-edbed380b1b6"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '702aba5d-32d4-47c1-8cf2-edbed380b1b6', 'no_device': None, 'attachment_id': '1dc8c2a0-c3ca-453a-aaeb-f9e39dc3cf13'} {{(pid=72178) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 01 12:01:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0198569d-7605-4bbe-8806-109270a38f11 tempest-TestVolumeSwap-1488774111 tempest-TestVolumeSwap-1488774111-project-admin] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.768s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:01:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:01:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:01:58 user nova-compute[72178]: INFO nova.compute.manager [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Detaching volume 702aba5d-32d4-47c1-8cf2-edbed380b1b6
Aug 01 12:01:59 user nova-compute[72178]: INFO nova.virt.block_device [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Attempting to driver detach volume 702aba5d-32d4-47c1-8cf2-edbed380b1b6 from mountpoint /dev/vdb
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Attempting to detach device vdb from instance ddde3963-45a3-4c13-9a58-134d87babeaf from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:01:59 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:59 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:01:59 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:01:59 user nova-compute[72178]:   <serial>702aba5d-32d4-47c1-8cf2-edbed380b1b6</serial>
Aug 01 12:01:59 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:01:59 user nova-compute[72178]: </disk>
Aug 01 12:01:59 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:01:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Successfully detached device vdb from instance ddde3963-45a3-4c13-9a58-134d87babeaf from the persistent domain config.
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddde3963-45a3-4c13-9a58-134d87babeaf from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:01:59 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:01:59 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:01:59 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:01:59 user nova-compute[72178]:   <serial>702aba5d-32d4-47c1-8cf2-edbed380b1b6</serial>
Aug 01 12:01:59 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:01:59 user nova-compute[72178]: </disk>
Aug 01 12:01:59 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891319.5028422, ddde3963-45a3-4c13-9a58-134d87babeaf => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:01:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Successfully detached device vdb from instance ddde3963-45a3-4c13-9a58-134d87babeaf from the live domain config.
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UeRcklsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '702aba5d-32d4-47c1-8cf2-edbed380b1b6'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:59 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e1e95-cb60-4091-8a43-8f98c3462698]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bfd2ee-8335-4a9b-97cd-5fbb2d4908b6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:59 user nova-compute[72178]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:59 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:59 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 (non-flash)
Aug 01 12:01:59 user nova-compute[72178]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:01:59 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:01:59 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:01:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9041243a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6'): ({'sdf'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Removing single pathed devices sdf {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[727d738c-a7be-4e70-81b3-aaabcc166613]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd42b0-f22d-409e-a7b2-469f99afa26b]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Flushing IO for device /dev/sdf {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd12c213-7fe5-4399-b38c-d1a6f6a8e529]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.utils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[788438f5-229f-4878-9f00-4c92db02b91d]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[891e0db5-4f43-41f9-b511-d68061ceab7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90eca51-30b6-4c12-97cc-ad6ce6ecc640]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[14adc9f8-9e0f-43f0-ac76-dae8700d644f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb18eb2-4f6e-425f-8b26-7c796553c540]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[08517c7e-ed82-46d0-b3dd-daa6f23bfbda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ca5b0-2306-49a7-abb4-655a23b27502]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260]
Aug 01 12:01:59 user nova-compute[72178]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6, portal: 172.16.0.220,3260] successful.
Aug 01 12:01:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:01:59 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a625a-1bad-4e4a-819e-409223b93bb9]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.utils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updating existing volume attachment record: cd0fb301-ddeb-4eee-93b3-024f6814749d {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:702aba5d-32d4-47c1-8cf2-edbed380b1b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdac8b77-1b55-4c87-80e3-d79e313fe3f2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] <== disconnect_volume: return (319ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:01:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:02:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:00 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lazy-loading 'flavor' on Instance uuid ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3ab1110d-3afd-4eab-ac14-d48ed3082776 tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.913s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-a0613a43-711a-4643-9ca9-73f9b21a9643 req-94550bb5-34a2-4394-9f0a-0e6a56ca7b36 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-changed-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-a0613a43-711a-4643-9ca9-73f9b21a9643 req-94550bb5-34a2-4394-9f0a-0e6a56ca7b36 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing instance network info cache due to event network-changed-192e5655-670b-4556-a74b-9f3ac045b973. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:02:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a0613a43-711a-4643-9ca9-73f9b21a9643 req-94550bb5-34a2-4394-9f0a-0e6a56ca7b36 service nova] Acquiring lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a0613a43-711a-4643-9ca9-73f9b21a9643 req-94550bb5-34a2-4394-9f0a-0e6a56ca7b36 service nova] Acquired lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-a0613a43-711a-4643-9ca9-73f9b21a9643 req-94550bb5-34a2-4394-9f0a-0e6a56ca7b36 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Refreshing network info cache for port 192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:02:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:02 user nova-compute[72178]: DEBUG nova.network.neutron [req-a0613a43-711a-4643-9ca9-73f9b21a9643 req-94550bb5-34a2-4394-9f0a-0e6a56ca7b36 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updated VIF entry in instance network info cache for port 192e5655-670b-4556-a74b-9f3ac045b973. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:02:02 user nova-compute[72178]: DEBUG nova.network.neutron [req-a0613a43-711a-4643-9ca9-73f9b21a9643 req-94550bb5-34a2-4394-9f0a-0e6a56ca7b36 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [{"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a0613a43-711a-4643-9ca9-73f9b21a9643 req-94550bb5-34a2-4394-9f0a-0e6a56ca7b36 service nova] Releasing lock "refresh_cache-2ff02938-0f05-40d9-a1b2-f916818da57c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:04 user nova-compute[72178]: INFO nova.compute.manager [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Terminating instance
Aug 01 12:02:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-fbc18b30-7528-4c7e-8519-0ed9c6473260 req-44abfb8f-8506-42e4-9931-d992d65b8324 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fbc18b30-7528-4c7e-8519-0ed9c6473260 req-44abfb8f-8506-42e4-9931-d992d65b8324 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fbc18b30-7528-4c7e-8519-0ed9c6473260 req-44abfb8f-8506-42e4-9931-d992d65b8324 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fbc18b30-7528-4c7e-8519-0ed9c6473260 req-44abfb8f-8506-42e4-9931-d992d65b8324 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-fbc18b30-7528-4c7e-8519-0ed9c6473260 req-44abfb8f-8506-42e4-9931-d992d65b8324 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-unplugged-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-fbc18b30-7528-4c7e-8519-0ed9c6473260 req-44abfb8f-8506-42e4-9931-d992d65b8324 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-192e5655-670b-4556-a74b-9f3ac045b973 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:02:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-a231bd65-0a07-410a-b748-ca44173abc0e req-615cad4e-435e-4e73-9238-a25d5640d981 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a231bd65-0a07-410a-b748-ca44173abc0e req-615cad4e-435e-4e73-9238-a25d5640d981 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a231bd65-0a07-410a-b748-ca44173abc0e req-615cad4e-435e-4e73-9238-a25d5640d981 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a231bd65-0a07-410a-b748-ca44173abc0e req-615cad4e-435e-4e73-9238-a25d5640d981 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-a231bd65-0a07-410a-b748-ca44173abc0e req-615cad4e-435e-4e73-9238-a25d5640d981 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-unplugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-a231bd65-0a07-410a-b748-ca44173abc0e req-615cad4e-435e-4e73-9238-a25d5640d981 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-80b241a8-e13c-4c7f-957f-5a154ce07737 req-d5abddec-14d9-4d97-9297-a25fe13ad483 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-80b241a8-e13c-4c7f-957f-5a154ce07737 req-d5abddec-14d9-4d97-9297-a25fe13ad483 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-80b241a8-e13c-4c7f-957f-5a154ce07737 req-d5abddec-14d9-4d97-9297-a25fe13ad483 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-80b241a8-e13c-4c7f-957f-5a154ce07737 req-d5abddec-14d9-4d97-9297-a25fe13ad483 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-80b241a8-e13c-4c7f-957f-5a154ce07737 req-d5abddec-14d9-4d97-9297-a25fe13ad483 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-unplugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-80b241a8-e13c-4c7f-957f-5a154ce07737 req-d5abddec-14d9-4d97-9297-a25fe13ad483 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Instance destroyed successfully.
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.objects.instance [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lazy-loading 'resources' on Instance uuid 2ff02938-0f05-40d9-a1b2-f916818da57c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:c6:f8,bridge_name='br-int',has_traffic_filtering=True,id=192e5655-670b-4556-a74b-9f3ac045b973,network=Network(ddd5f15f-ece8-401c-ae07-404fa6ca1a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192e5655-67') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:c6:f8,bridge_name='br-int',has_traffic_filtering=True,id=192e5655-670b-4556-a74b-9f3ac045b973,network=Network(ddd5f15f-ece8-401c-ae07-404fa6ca1a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192e5655-67') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap192e5655-67, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: INFO os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:c6:f8,bridge_name='br-int',has_traffic_filtering=True,id=192e5655-670b-4556-a74b-9f3ac045b973,network=Network(ddd5f15f-ece8-401c-ae07-404fa6ca1a6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap192e5655-67')
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=378bd5f0-98a0-47c7-8583-2643fceeef0e,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap378bd5f0-98') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=378bd5f0-98a0-47c7-8583-2643fceeef0e,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap378bd5f0-98') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap378bd5f0-98, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: INFO os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:40:aa,bridge_name='br-int',has_traffic_filtering=True,id=378bd5f0-98a0-47c7-8583-2643fceeef0e,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap378bd5f0-98')
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:7b,bridge_name='br-int',has_traffic_filtering=True,id=a55a564d-20e1-4d97-9b4a-f34cf6bf63a8,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa55a564d-20') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:7b,bridge_name='br-int',has_traffic_filtering=True,id=a55a564d-20e1-4d97-9b4a-f34cf6bf63a8,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa55a564d-20') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa55a564d-20, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: INFO os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:28:7b,bridge_name='br-int',has_traffic_filtering=True,id=a55a564d-20e1-4d97-9b4a-f34cf6bf63a8,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa55a564d-20')
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "address": "fa:16:3e:5c:af:4b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba611d3c-04", "ovs_interfaceid": "ba611d3c-04a7-4141-9a95-13264e8dacd1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:4b,bridge_name='br-int',has_traffic_filtering=True,id=ba611d3c-04a7-4141-9a95-13264e8dacd1,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba611d3c-04') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:4b,bridge_name='br-int',has_traffic_filtering=True,id=ba611d3c-04a7-4141-9a95-13264e8dacd1,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba611d3c-04') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba611d3c-04, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: INFO os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:af:4b,bridge_name='br-int',has_traffic_filtering=True,id=ba611d3c-04a7-4141-9a95-13264e8dacd1,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba611d3c-04')
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:e7,bridge_name='br-int',has_traffic_filtering=True,id=fef3b207-5b27-4d85-8c77-9be9d120bfee,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef3b207-5b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:e7,bridge_name='br-int',has_traffic_filtering=True,id=fef3b207-5b27-4d85-8c77-9be9d120bfee,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef3b207-5b') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfef3b207-5b, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: INFO os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:c0:e7,bridge_name='br-int',has_traffic_filtering=True,id=fef3b207-5b27-4d85-8c77-9be9d120bfee,network=Network(96b36037-d0d6-4235-9a4c-f437ef52e75d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfef3b207-5b')
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:0b:cf,bridge_name='br-int',has_traffic_filtering=True,id=055aa952-e6f0-4045-a87c-5569479d7175,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055aa952-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:0b:cf,bridge_name='br-int',has_traffic_filtering=True,id=055aa952-e6f0-4045-a87c-5569479d7175,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055aa952-e6') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap055aa952-e6, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: INFO os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:0b:cf,bridge_name='br-int',has_traffic_filtering=True,id=055aa952-e6f0-4045-a87c-5569479d7175,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap055aa952-e6')
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:00:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-386396453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-386396453',id=12,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLtrnlhPOSmEuW9lLAHSz6POYNCoTpAAxvQiv2LGh4+zzTSzDgsVj8/mtxBbnMG76WYT4klORuIzYtnlNYYoJBa71USrKDGrfXpGNgYB5yKl40wvTDjn4ziFi1xriuUbg==',key_name='tempest-keypair-1808580579',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b23388659ea48dda1be9a1b6a2537d6',ramdisk_id='',reservation_id='r-l30izxi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-956691496',owner_user_name='tempest-TaggedBootDevicesTest-956691496-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='89b7c640c2704a67989885f951fbf7d9',uuid=2ff02938-0f05-40d9-a1b2-f916818da57c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converting VIF {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:44:20,bridge_name='br-int',has_traffic_filtering=True,id=8e23d40f-539b-4b6c-84dc-2afacd8fd2e2,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23d40f-53') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:44:20,bridge_name='br-int',has_traffic_filtering=True,id=8e23d40f-539b-4b6c-84dc-2afacd8fd2e2,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23d40f-53') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e23d40f-53, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:06 user nova-compute[72178]: INFO os_vif [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:44:20,bridge_name='br-int',has_traffic_filtering=True,id=8e23d40f-539b-4b6c-84dc-2afacd8fd2e2,network=Network(49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e23d40f-53')
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NqHigVsd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:06 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[177e3b70-9236-4084-805c-123059046cba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f934f2-8118-412b-9768-18c29d18c556]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:02:06 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:02:06 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:02:06 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 (non-flash)
Aug 01 12:02:06 user nova-compute[72178]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:02:06 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:02:06 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040d1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273'): ({'sdb'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Removing single pathed devices sdb {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[725521e7-343e-4b29-8000-1cc9a85b8278]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce72a18-0e41-4a6e-b867-d0a112a28cc2]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Flushing IO for device /dev/sdb {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9d0625-5147-4d76-9c0c-3b17f08cf135]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a8245-b965-4adb-ad8f-ddd837d20ffa]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b4c77b-d59a-403e-9b14-96c394fe15e8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3347df29-e876-434e-bce3-7e52e43137de]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273, portal: 172.16.0.220,3260]
Aug 01 12:02:06 user nova-compute[72178]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:06 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:06 user nova-compute[72178]: WARNING nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-192e5655-670b-4556-a74b-9f3ac045b973 for instance with vm_state active and task_state deleting.
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-unplugged-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-378bd5f0-98a0-47c7-8583-2643fceeef0e for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:06 user nova-compute[72178]: WARNING nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-378bd5f0-98a0-47c7-8583-2643fceeef0e for instance with vm_state active and task_state deleting.
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-unplugged-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-fef3b207-5b27-4d85-8c77-9be9d120bfee for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:06 user nova-compute[72178]: WARNING nova.compute.manager [req-a9c933e5-de66-45d2-9316-454fdeb4a97f req-a30b0009-7ea6-44cc-8143-94917fd1bb57 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-fef3b207-5b27-4d85-8c77-9be9d120bfee for instance with vm_state active and task_state deleting.
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:116d7afb-beff-4a51-95d6-e15e3311d273 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94d13fe-81e2-4d41-8bee-0d0246ae5201]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== disconnect_volume: return (284ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsSLEPoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:06 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b98b4-d425-4f0e-8f94-27b478162fe6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcd2ef0-aed6-4ee2-99ec-3f137c8a1602]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:02:07 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:02:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b (non-flash)
Aug 01 12:02:07 user nova-compute[72178]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:02:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040d1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e6576-9c83-4bbf-a611-901b9630fdd7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5101b72e-98d8-45ae-86ac-c1cfa426deb6]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[88219d47-daf4-4334-a548-0bad54c29e76]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[090b1f45-be8f-4ec1-9890-c377703a2235]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ffb548-ea93-4550-82f0-8668b302fc64]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2489e3a2-a1b6-4fc3-a541-fa51bd4e9385]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b, portal: 172.16.0.220,3260]
Aug 01 12:02:07 user nova-compute[72178]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:417cde5d-ff21-4060-8f92-40ef4b702f2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[263ca29d-0c49-4e81-8093-9d8cf7c34e96]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== disconnect_volume: return (294ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OAbicTnP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:07 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7966cfb-cdbf-48dc-b90c-0f79a0d330b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e97fc-b5a2-4ac2-b254-7c345cebc84b]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:02:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 (non-flash)
Aug 01 12:02:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040d1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:07 user nova-compute[72178]: WARNING nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-a55a564d-20e1-4d97-9b4a-f34cf6bf63a8 for instance with vm_state active and task_state deleting.
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-unplugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:07 user nova-compute[72178]: WARNING nova.compute.manager [req-5f580f13-ae92-44ae-b626-ba0c22119a87 req-8d2c7d66-5ab3-4519-9e20-81f80c3c27c8 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 for instance with vm_state active and task_state deleting.
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2457e54-68a9-4c00-83cf-784890d2b521]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[408953c8-def5-4e5e-beec-a9f971ffdefb]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b2f9be-0715-409a-8f56-3910c597d8c7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78a8b5d-9fb7-4771-865f-32c3f73352af]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a1601b-4d27-4a68-b11a-8554d3f3f10c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:07 user nova-compute[72178]: WARNING nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-ba611d3c-04a7-4141-9a95-13264e8dacd1 for instance with vm_state active and task_state deleting.
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-unplugged-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-unplugged-055aa952-e6f0-4045-a87c-5569479d7175 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Acquiring lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] No waiting events found dispatching network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:07 user nova-compute[72178]: WARNING nova.compute.manager [req-f096b651-7c39-442b-828d-1ddf8923e022 req-bb622618-e73d-4032-8f97-bb6468ef66fc service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received unexpected event network-vif-plugged-055aa952-e6f0-4045-a87c-5569479d7175 for instance with vm_state active and task_state deleting.
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6278f4c-9c7f-4735-bea1-86d3b5b10c8a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9, portal: 172.16.0.220,3260]
Aug 01 12:02:07 user nova-compute[72178]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:753b30b9-d013-45cc-a2d1-322cd1d0cac9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e912f4f5-1b20-4eaf-9208-29458002f4bd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] <== disconnect_volume: return (289ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:02:07 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Deleting instance files /opt/stack/data/nova/instances/2ff02938-0f05-40d9-a1b2-f916818da57c_del
Aug 01 12:02:07 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Deletion of /opt/stack/data/nova/instances/2ff02938-0f05-40d9-a1b2-f916818da57c_del complete
Aug 01 12:02:07 user nova-compute[72178]: INFO nova.compute.manager [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Took 3.08 seconds to destroy the instance on the hypervisor.
Aug 01 12:02:07 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:02:07 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:02:08 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Creating image(s)
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Ensure instance console log exists: /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Start _get_guest_xml network_info=[{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKHUevhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd3870f4a-ea47-4075-b342-2b20cfa749f9', 'attached_at': '', 'detached_at': '', 'volume_id': 'bed47c42-bdf4-47ca-8963-50ec3e68e25c', 'serial': 'bed47c42-bdf4-47ca-8963-50ec3e68e25c'}, 'boot_index': 0, 'attachment_id': 'cd0fb301-ddeb-4eee-93b3-024f6814749d', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:02:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKHUevhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:08 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:08 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:08 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2a1574-9608-4203-8857-db3c0378fb69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:02:08 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3822f9-c03a-4fdf-ae05-9f1b6d2ae999]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c] added
Aug 01 12:02:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[065d6121-c319-4a22-a04c-f2f1f55dbe26]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8881f83b-a71d-49a9-aacd-ab1d0085eeea]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKHUevhI {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKHUevhI" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aabf17-1de8-4799-b5ec-694c8d9c7570]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tKHUevhI'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bdbd94-ba5e-498a-a40d-732db4a5cb74]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a908122-626b-4751-a748-4fdbb612610d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:02:08 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:02:08 user nova-compute[72178]:  {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:08 user nova-compute[72178]: WARNING os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 12:02:08 user nova-compute[72178]: 
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0341cb-9750-400a-ab9f-c819dca478f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c, portal: 172.16.0.220,3260]
Aug 01 12:02:08 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[02019b85-b394-4ee3-8416-fb983a91acc5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2f8284-dc37-4bfa-bb48-8e217b7681f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:09 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:09 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5551a207-2796-46ac-ad0d-0fa1abf3923a]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKHUevhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG nova.compute.manager [req-46eb1cd3-a3fa-4e37-b287-8546c01a00c4 req-984245ab-5153-4313-8fd1-403eabf2ead0 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-deleted-ba611d3c-04a7-4141-9a95-13264e8dacd1 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:09 user nova-compute[72178]: INFO nova.compute.manager [req-46eb1cd3-a3fa-4e37-b287-8546c01a00c4 req-984245ab-5153-4313-8fd1-403eabf2ead0 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Neutron deleted interface ba611d3c-04a7-4141-9a95-13264e8dacd1; detaching it from the instance and deleting it from the info cache
Aug 01 12:02:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-46eb1cd3-a3fa-4e37-b287-8546c01a00c4 req-984245ab-5153-4313-8fd1-403eabf2ead0 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [{"id": "192e5655-670b-4556-a74b-9f3ac045b973", "address": "fa:16:3e:96:c6:f8", "network": {"id": "ddd5f15f-ece8-401c-ae07-404fa6ca1a6b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-287085655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap192e5655-67", "ovs_interfaceid": "192e5655-670b-4556-a74b-9f3ac045b973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "address": "fa:16:3e:1c:40:aa", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378bd5f0-98", "ovs_interfaceid": "378bd5f0-98a0-47c7-8583-2643fceeef0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "address": "fa:16:3e:a7:28:7b", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55a564d-20", "ovs_interfaceid": "a55a564d-20e1-4d97-9b4a-f34cf6bf63a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "address": "fa:16:3e:a9:c0:e7", "network": {"id": "96b36037-d0d6-4235-9a4c-f437ef52e75d", "bridge": "br-int", "label": "tempest-device-tagging-net1-167385941", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfef3b207-5b", "ovs_interfaceid": "fef3b207-5b27-4d85-8c77-9be9d120bfee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "055aa952-e6f0-4045-a87c-5569479d7175", "address": "fa:16:3e:b3:0b:cf", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap055aa952-e6", "ovs_interfaceid": "055aa952-e6f0-4045-a87c-5569479d7175", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "address": "fa:16:3e:88:44:20", "network": {"id": "49fbe01d-d5c0-4bdf-bbb3-1a602e4c6527", "bridge": "br-int", "label": "tempest-device-tagging-net2-145535927", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9b23388659ea48dda1be9a1b6a2537d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e23d40f-53", "ovs_interfaceid": "8e23d40f-539b-4b6c-84dc-2afacd8fd2e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:09 user nova-compute[72178]: DEBUG nova.compute.manager [req-46eb1cd3-a3fa-4e37-b287-8546c01a00c4 req-984245ab-5153-4313-8fd1-403eabf2ead0 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Detach interface failed, port_id=ba611d3c-04a7-4141-9a95-13264e8dacd1, reason: Instance 2ff02938-0f05-40d9-a1b2-f916818da57c could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23535353930383539', 'path': '/dev/sdb'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535353930383539', 'path': '/dev/sdb'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-280081968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-280081968',id=14,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-js1gllif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:01:54Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=d3870f4a-ea47-4075-b342-2b20cfa749f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=b7d6253a-cf03-47ad-8398-2a9c13e58116,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d6253a-cf') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'pci_devices' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:02:10 user nova-compute[72178]:   <uuid>d3870f4a-ea47-4075-b342-2b20cfa749f9</uuid>
Aug 01 12:02:10 user nova-compute[72178]:   <name>instance-0000000e</name>
Aug 01 12:02:10 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:02:10 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:02:10 user nova-compute[72178]:   <metadata>
Aug 01 12:02:10 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:02:10 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:02:10 user nova-compute[72178]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-280081968</nova:name>
Aug 01 12:02:10 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:02:08</nova:creationTime>
Aug 01 12:02:10 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:02:10 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:02:10 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:02:10 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:02:10 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:02:10 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:02:10 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:02:10 user nova-compute[72178]:       <nova:owner>
Aug 01 12:02:10 user nova-compute[72178]:         <nova:user uuid="ec0992e3a27a4a44922268a46b27ad83">tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member</nova:user>
Aug 01 12:02:10 user nova-compute[72178]:         <nova:project uuid="d5e2fc3212d24561b0b971241fe367ec">tempest-ServerBootFromVolumeStableRescueTest-2013636577</nova:project>
Aug 01 12:02:10 user nova-compute[72178]:       </nova:owner>
Aug 01 12:02:10 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:02:10 user nova-compute[72178]:       <nova:ports>
Aug 01 12:02:10 user nova-compute[72178]:         <nova:port uuid="b7d6253a-cf03-47ad-8398-2a9c13e58116">
Aug 01 12:02:10 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 12:02:10 user nova-compute[72178]:         </nova:port>
Aug 01 12:02:10 user nova-compute[72178]:       </nova:ports>
Aug 01 12:02:10 user nova-compute[72178]:     </nova:instance>
Aug 01 12:02:10 user nova-compute[72178]:   </metadata>
Aug 01 12:02:10 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:02:10 user nova-compute[72178]:     <system>
Aug 01 12:02:10 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:02:10 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:02:10 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:02:10 user nova-compute[72178]:       <entry name="serial">d3870f4a-ea47-4075-b342-2b20cfa749f9</entry>
Aug 01 12:02:10 user nova-compute[72178]:       <entry name="uuid">d3870f4a-ea47-4075-b342-2b20cfa749f9</entry>
Aug 01 12:02:10 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:02:10 user nova-compute[72178]:     </system>
Aug 01 12:02:10 user nova-compute[72178]:   </sysinfo>
Aug 01 12:02:10 user nova-compute[72178]:   <os>
Aug 01 12:02:10 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:02:10 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:02:10 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:02:10 user nova-compute[72178]:   </os>
Aug 01 12:02:10 user nova-compute[72178]:   <features>
Aug 01 12:02:10 user nova-compute[72178]:     <acpi/>
Aug 01 12:02:10 user nova-compute[72178]:     <apic/>
Aug 01 12:02:10 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:02:10 user nova-compute[72178]:   </features>
Aug 01 12:02:10 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:02:10 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:02:10 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:02:10 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:02:10 user nova-compute[72178]:   </clock>
Aug 01 12:02:10 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:02:10 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:02:10 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:02:10 user nova-compute[72178]:   </cpu>
Aug 01 12:02:10 user nova-compute[72178]:   <devices>
Aug 01 12:02:10 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:02:10 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:02:10 user nova-compute[72178]:       <source dev="/dev/sdb"/>
Aug 01 12:02:10 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:02:10 user nova-compute[72178]:       <serial>bed47c42-bdf4-47ca-8963-50ec3e68e25c</serial>
Aug 01 12:02:10 user nova-compute[72178]:     </disk>
Aug 01 12:02:10 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:02:10 user nova-compute[72178]:       <mac address="fa:16:3e:d8:e0:4a"/>
Aug 01 12:02:10 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:02:10 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:02:10 user nova-compute[72178]:       <target dev="tapb7d6253a-cf"/>
Aug 01 12:02:10 user nova-compute[72178]:     </interface>
Aug 01 12:02:10 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:02:10 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/console.log" append="off"/>
Aug 01 12:02:10 user nova-compute[72178]:     </serial>
Aug 01 12:02:10 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:02:10 user nova-compute[72178]:     <video>
Aug 01 12:02:10 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:02:10 user nova-compute[72178]:     </video>
Aug 01 12:02:10 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:02:10 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:02:10 user nova-compute[72178]:     </rng>
Aug 01 12:02:10 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:02:10 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:02:10 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:02:10 user nova-compute[72178]:     </memballoon>
Aug 01 12:02:10 user nova-compute[72178]:   </devices>
Aug 01 12:02:10 user nova-compute[72178]: </domain>
Aug 01 12:02:10 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-280081968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-280081968',id=14,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-js1gllif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:01:54Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=d3870f4a-ea47-4075-b342-2b20cfa749f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=b7d6253a-cf03-47ad-8398-2a9c13e58116,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d6253a-cf') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG os_vif [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=b7d6253a-cf03-47ad-8398-2a9c13e58116,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d6253a-cf') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7d6253a-cf, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7d6253a-cf, col_values=(('external_ids', {'iface-id': 'b7d6253a-cf03-47ad-8398-2a9c13e58116', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:e0:4a', 'vm-uuid': 'd3870f4a-ea47-4075-b342-2b20cfa749f9'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:10 user nova-compute[72178]: INFO os_vif [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=b7d6253a-cf03-47ad-8398-2a9c13e58116,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d6253a-cf')
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No VIF found with MAC fa:16:3e:d8:e0:4a, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:11 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Took 4.00 seconds to deallocate network for instance.
Aug 01 12:02:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-f27d5b84-dda1-4eef-9864-56dc9393f928 req-4a097c69-d728-4838-9717-b923c2e7ff91 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-deleted-8e23d40f-539b-4b6c-84dc-2afacd8fd2e2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-f27d5b84-dda1-4eef-9864-56dc9393f928 req-4a097c69-d728-4838-9717-b923c2e7ff91 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-deleted-055aa952-e6f0-4045-a87c-5569479d7175 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-f27d5b84-dda1-4eef-9864-56dc9393f928 req-4a097c69-d728-4838-9717-b923c2e7ff91 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-deleted-fef3b207-5b27-4d85-8c77-9be9d120bfee {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-f27d5b84-dda1-4eef-9864-56dc9393f928 req-4a097c69-d728-4838-9717-b923c2e7ff91 service nova] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Received event network-vif-deleted-192e5655-670b-4556-a74b-9f3ac045b973 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-9cbd2700-f39e-4e4e-8e9d-857e04ae6906 req-618a7336-e507-4a2d-96d7-9fc15741a5fb service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cbd2700-f39e-4e4e-8e9d-857e04ae6906 req-618a7336-e507-4a2d-96d7-9fc15741a5fb service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cbd2700-f39e-4e4e-8e9d-857e04ae6906 req-618a7336-e507-4a2d-96d7-9fc15741a5fb service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cbd2700-f39e-4e4e-8e9d-857e04ae6906 req-618a7336-e507-4a2d-96d7-9fc15741a5fb service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-9cbd2700-f39e-4e4e-8e9d-857e04ae6906 req-618a7336-e507-4a2d-96d7-9fc15741a5fb service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:11 user nova-compute[72178]: WARNING nova.compute.manager [req-9cbd2700-f39e-4e4e-8e9d-857e04ae6906 req-618a7336-e507-4a2d-96d7-9fc15741a5fb service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state building and task_state spawning.
Aug 01 12:02:13 user nova-compute[72178]: INFO nova.compute.manager [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Took 2.25 seconds to detach 3 volumes for instance.
Aug 01 12:02:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:13 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891333.959755, d3870f4a-ea47-4075-b342-2b20cfa749f9 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:13 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] VM Resumed (Lifecycle Event)
Aug 01 12:02:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:02:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:02:13 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance spawned successfully.
Aug 01 12:02:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:02:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:02:14 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891333.9611657, d3870f4a-ea47-4075-b342-2b20cfa749f9 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:14 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] VM Started (Lifecycle Event)
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-315d9639-d833-4131-8b36-5f1678cf7f4d req-b268d532-0451-45d7-b33e-464cc90e9709 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-315d9639-d833-4131-8b36-5f1678cf7f4d req-b268d532-0451-45d7-b33e-464cc90e9709 service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-315d9639-d833-4131-8b36-5f1678cf7f4d req-b268d532-0451-45d7-b33e-464cc90e9709 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-315d9639-d833-4131-8b36-5f1678cf7f4d req-b268d532-0451-45d7-b33e-464cc90e9709 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-315d9639-d833-4131-8b36-5f1678cf7f4d req-b268d532-0451-45d7-b33e-464cc90e9709 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:14 user nova-compute[72178]: WARNING nova.compute.manager [req-315d9639-d833-4131-8b36-5f1678cf7f4d req-b268d532-0451-45d7-b33e-464cc90e9709 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state building and task_state spawning.
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:02:14 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:02:14 user nova-compute[72178]: INFO nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:14 user nova-compute[72178]: INFO nova.compute.manager [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Took 21.33 seconds to build instance.
Aug 01 12:02:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8af6a2b8-120a-404d-bba0-2b9b68792b7f tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.474s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:14 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Deleted allocations for instance 2ff02938-0f05-40d9-a1b2-f916818da57c
Aug 01 12:02:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-31f877a8-7976-428b-8224-3b71f27baf8a tempest-TaggedBootDevicesTest-956691496 tempest-TaggedBootDevicesTest-956691496-project-member] Lock "2ff02938-0f05-40d9-a1b2-f916818da57c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.997s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "a742f6ab-310e-4652-968d-7840febae699" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "a742f6ab-310e-4652-968d-7840febae699" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:02:16 user nova-compute[72178]: INFO nova.compute.claims [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Claim successful on node user
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:02:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.policy [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc6bcb5e39f04635abbc68fcddfcf8d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '966cb02845ea40aea6b64cabe1f600c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:02:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Creating image(s)
Aug 01 12:02:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "/opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "/opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "/opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk 1073741824" returned: 0 in 0.049s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Successfully created port: e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Cannot resize image /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'migration_context' on Instance uuid a742f6ab-310e-4652-968d-7840febae699 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Ensure instance console log exists: /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Successfully updated port: e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "refresh_cache-a742f6ab-310e-4652-968d-7840febae699" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquired lock "refresh_cache-a742f6ab-310e-4652-968d-7840febae699" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-ad7a7be7-1616-4139-a46b-d2530d8675f4 req-ca33ac07-aab4-402e-ac97-e607332b3f45 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received event network-changed-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-ad7a7be7-1616-4139-a46b-d2530d8675f4 req-ca33ac07-aab4-402e-ac97-e607332b3f45 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Refreshing instance network info cache due to event network-changed-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ad7a7be7-1616-4139-a46b-d2530d8675f4 req-ca33ac07-aab4-402e-ac97-e607332b3f45 service nova] Acquiring lock "refresh_cache-a742f6ab-310e-4652-968d-7840febae699" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Updating instance_info_cache with network_info: [{"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Releasing lock "refresh_cache-a742f6ab-310e-4652-968d-7840febae699" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Instance network_info: |[{"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ad7a7be7-1616-4139-a46b-d2530d8675f4 req-ca33ac07-aab4-402e-ac97-e607332b3f45 service nova] Acquired lock "refresh_cache-a742f6ab-310e-4652-968d-7840febae699" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-ad7a7be7-1616-4139-a46b-d2530d8675f4 req-ca33ac07-aab4-402e-ac97-e607332b3f45 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Refreshing network info cache for port e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Start _get_guest_xml network_info=[{"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:02:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-494976912',display_name='tempest-VolumesAdminNegativeTest-server-494976912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-494976912',id=15,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='966cb02845ea40aea6b64cabe1f600c2',ramdisk_id='',reservation_id='r-lzjtr0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1802258801',owner_user_name='tempest-VolumesAdminNegativeTest-1802258801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:17Z,user_data=None,user_id='fc6bcb5e39f04635abbc68fcddfcf8d1',uuid=a742f6ab-310e-4652-968d-7840febae699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converting VIF {"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:5e:8c,bridge_name='br-int',has_traffic_filtering=True,id=e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5c59c-8a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'pci_devices' on Instance uuid a742f6ab-310e-4652-968d-7840febae699 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:02:18 user nova-compute[72178]:   <uuid>a742f6ab-310e-4652-968d-7840febae699</uuid>
Aug 01 12:02:18 user nova-compute[72178]:   <name>instance-0000000f</name>
Aug 01 12:02:18 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:02:18 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:02:18 user nova-compute[72178]:   <metadata>
Aug 01 12:02:18 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:02:18 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:02:18 user nova-compute[72178]:       <nova:name>tempest-VolumesAdminNegativeTest-server-494976912</nova:name>
Aug 01 12:02:18 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:02:18</nova:creationTime>
Aug 01 12:02:18 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:02:18 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:02:18 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:02:18 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:02:18 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:02:18 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:02:18 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:02:18 user nova-compute[72178]:       <nova:owner>
Aug 01 12:02:18 user nova-compute[72178]:         <nova:user uuid="fc6bcb5e39f04635abbc68fcddfcf8d1">tempest-VolumesAdminNegativeTest-1802258801-project-member</nova:user>
Aug 01 12:02:18 user nova-compute[72178]:         <nova:project uuid="966cb02845ea40aea6b64cabe1f600c2">tempest-VolumesAdminNegativeTest-1802258801</nova:project>
Aug 01 12:02:18 user nova-compute[72178]:       </nova:owner>
Aug 01 12:02:18 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:02:18 user nova-compute[72178]:       <nova:ports>
Aug 01 12:02:18 user nova-compute[72178]:         <nova:port uuid="e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc">
Aug 01 12:02:18 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 12:02:18 user nova-compute[72178]:         </nova:port>
Aug 01 12:02:18 user nova-compute[72178]:       </nova:ports>
Aug 01 12:02:18 user nova-compute[72178]:     </nova:instance>
Aug 01 12:02:18 user nova-compute[72178]:   </metadata>
Aug 01 12:02:18 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:02:18 user nova-compute[72178]:     <system>
Aug 01 12:02:18 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:02:18 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:02:18 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:02:18 user nova-compute[72178]:       <entry name="serial">a742f6ab-310e-4652-968d-7840febae699</entry>
Aug 01 12:02:18 user nova-compute[72178]:       <entry name="uuid">a742f6ab-310e-4652-968d-7840febae699</entry>
Aug 01 12:02:18 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:02:18 user nova-compute[72178]:     </system>
Aug 01 12:02:18 user nova-compute[72178]:   </sysinfo>
Aug 01 12:02:18 user nova-compute[72178]:   <os>
Aug 01 12:02:18 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:02:18 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:02:18 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:02:18 user nova-compute[72178]:   </os>
Aug 01 12:02:18 user nova-compute[72178]:   <features>
Aug 01 12:02:18 user nova-compute[72178]:     <acpi/>
Aug 01 12:02:18 user nova-compute[72178]:     <apic/>
Aug 01 12:02:18 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:02:18 user nova-compute[72178]:   </features>
Aug 01 12:02:18 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:02:18 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:02:18 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:02:18 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:02:18 user nova-compute[72178]:   </clock>
Aug 01 12:02:18 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:02:18 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:02:18 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:02:18 user nova-compute[72178]:   </cpu>
Aug 01 12:02:18 user nova-compute[72178]:   <devices>
Aug 01 12:02:18 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:02:18 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:02:18 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk"/>
Aug 01 12:02:18 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:02:18 user nova-compute[72178]:     </disk>
Aug 01 12:02:18 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:02:18 user nova-compute[72178]:       <mac address="fa:16:3e:4c:5e:8c"/>
Aug 01 12:02:18 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:02:18 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:02:18 user nova-compute[72178]:       <target dev="tape9d5c59c-8a"/>
Aug 01 12:02:18 user nova-compute[72178]:     </interface>
Aug 01 12:02:18 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:02:18 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/console.log" append="off"/>
Aug 01 12:02:18 user nova-compute[72178]:     </serial>
Aug 01 12:02:18 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:02:18 user nova-compute[72178]:     <video>
Aug 01 12:02:18 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:02:18 user nova-compute[72178]:     </video>
Aug 01 12:02:18 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:02:18 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:02:18 user nova-compute[72178]:     </rng>
Aug 01 12:02:18 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:02:18 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:02:18 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:02:18 user nova-compute[72178]:     </memballoon>
Aug 01 12:02:18 user nova-compute[72178]:   </devices>
Aug 01 12:02:18 user nova-compute[72178]: </domain>
Aug 01 12:02:18 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-494976912',display_name='tempest-VolumesAdminNegativeTest-server-494976912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-494976912',id=15,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='966cb02845ea40aea6b64cabe1f600c2',ramdisk_id='',reservation_id='r-lzjtr0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1802258801',owner_user_name='tempest-VolumesAdminNegativeTest-1802258801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:17Z,user_data=None,user_id='fc6bcb5e39f04635abbc68fcddfcf8d1',uuid=a742f6ab-310e-4652-968d-7840febae699,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converting VIF {"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:5e:8c,bridge_name='br-int',has_traffic_filtering=True,id=e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5c59c-8a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG os_vif [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:5e:8c,bridge_name='br-int',has_traffic_filtering=True,id=e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5c59c-8a') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9d5c59c-8a, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9d5c59c-8a, col_values=(('external_ids', {'iface-id': 'e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:5e:8c', 'vm-uuid': 'a742f6ab-310e-4652-968d-7840febae699'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:18 user nova-compute[72178]: INFO os_vif [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:5e:8c,bridge_name='br-int',has_traffic_filtering=True,id=e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5c59c-8a')
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] No VIF found with MAC fa:16:3e:4c:5e:8c, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:02:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-ad7a7be7-1616-4139-a46b-d2530d8675f4 req-ca33ac07-aab4-402e-ac97-e607332b3f45 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Updated VIF entry in instance network info cache for port e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:02:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-ad7a7be7-1616-4139-a46b-d2530d8675f4 req-ca33ac07-aab4-402e-ac97-e607332b3f45 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Updating instance_info_cache with network_info: [{"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ad7a7be7-1616-4139-a46b-d2530d8675f4 req-ca33ac07-aab4-402e-ac97-e607332b3f45 service nova] Releasing lock "refresh_cache-a742f6ab-310e-4652-968d-7840febae699" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-12f7ecb6-f18e-4337-aec3-99b65b0ee1ca req-cfe76a65-7a90-4af2-85b1-41af3bcca1d4 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received event network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-12f7ecb6-f18e-4337-aec3-99b65b0ee1ca req-cfe76a65-7a90-4af2-85b1-41af3bcca1d4 service nova] Acquiring lock "a742f6ab-310e-4652-968d-7840febae699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-12f7ecb6-f18e-4337-aec3-99b65b0ee1ca req-cfe76a65-7a90-4af2-85b1-41af3bcca1d4 service nova] Lock "a742f6ab-310e-4652-968d-7840febae699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-12f7ecb6-f18e-4337-aec3-99b65b0ee1ca req-cfe76a65-7a90-4af2-85b1-41af3bcca1d4 service nova] Lock "a742f6ab-310e-4652-968d-7840febae699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-12f7ecb6-f18e-4337-aec3-99b65b0ee1ca req-cfe76a65-7a90-4af2-85b1-41af3bcca1d4 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] No waiting events found dispatching network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:20 user nova-compute[72178]: WARNING nova.compute.manager [req-12f7ecb6-f18e-4337-aec3-99b65b0ee1ca req-cfe76a65-7a90-4af2-85b1-41af3bcca1d4 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received unexpected event network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc for instance with vm_state building and task_state spawning.
Aug 01 12:02:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:21 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891326.3009436, 2ff02938-0f05-40d9-a1b2-f916818da57c => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:21 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] VM Stopped (Lifecycle Event)
Aug 01 12:02:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-eb0b5c8f-ec98-4373-9ef5-2121e4161e16 None None] [instance: 2ff02938-0f05-40d9-a1b2-f916818da57c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891342.355429, a742f6ab-310e-4652-968d-7840febae699 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] VM Resumed (Lifecycle Event)
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:02:22 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a742f6ab-310e-4652-968d-7840febae699] Instance spawned successfully.
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891342.358968, a742f6ab-310e-4652-968d-7840febae699 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] VM Started (Lifecycle Event)
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:02:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:02:22 user nova-compute[72178]: INFO nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:22 user nova-compute[72178]: INFO nova.compute.manager [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Took 6.54 seconds to build instance.
Aug 01 12:02:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ec43d0b1-2ae3-4f0a-a483-7f3e7627f070 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "a742f6ab-310e-4652-968d-7840febae699" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.622s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-45beb29b-3676-420f-8972-9c52a1e60989 req-2fe455d4-a7d2-430e-86e5-4c708d858385 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received event network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-45beb29b-3676-420f-8972-9c52a1e60989 req-2fe455d4-a7d2-430e-86e5-4c708d858385 service nova] Acquiring lock "a742f6ab-310e-4652-968d-7840febae699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-45beb29b-3676-420f-8972-9c52a1e60989 req-2fe455d4-a7d2-430e-86e5-4c708d858385 service nova] Lock "a742f6ab-310e-4652-968d-7840febae699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-45beb29b-3676-420f-8972-9c52a1e60989 req-2fe455d4-a7d2-430e-86e5-4c708d858385 service nova] Lock "a742f6ab-310e-4652-968d-7840febae699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-45beb29b-3676-420f-8972-9c52a1e60989 req-2fe455d4-a7d2-430e-86e5-4c708d858385 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] No waiting events found dispatching network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:22 user nova-compute[72178]: WARNING nova.compute.manager [req-45beb29b-3676-420f-8972-9c52a1e60989 req-2fe455d4-a7d2-430e-86e5-4c708d858385 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received unexpected event network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc for instance with vm_state active and task_state None.
Aug 01 12:02:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:02:23 user nova-compute[72178]: INFO nova.compute.claims [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Claim successful on node user
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:02:23 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:02:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:02:23 user nova-compute[72178]: DEBUG nova.policy [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a73caf203ad4e8aaac7a1efb956c048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22155938fca465f904a75e3d0a1bd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:02:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Creating image(s)
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk 1073741824" returned: 0 in 0.058s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Cannot resize image /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'migration_context' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Ensure instance console log exists: /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:24 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Successfully created port: 1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Successfully updated port: 1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquired lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.compute.manager [req-4a6134c9-c1bb-4ec4-b3e1-853da6f1e37d req-675cadc5-c853-4ad6-b06d-75c38ad470e2 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-changed-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.compute.manager [req-4a6134c9-c1bb-4ec4-b3e1-853da6f1e37d req-675cadc5-c853-4ad6-b06d-75c38ad470e2 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Refreshing instance network info cache due to event network-changed-1c228670-844c-44a4-ad61-a9982fe910fd. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4a6134c9-c1bb-4ec4-b3e1-853da6f1e37d req-675cadc5-c853-4ad6-b06d-75c38ad470e2 service nova] Acquiring lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating instance_info_cache with network_info: [{"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Releasing lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Instance network_info: |[{"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4a6134c9-c1bb-4ec4-b3e1-853da6f1e37d req-675cadc5-c853-4ad6-b06d-75c38ad470e2 service nova] Acquired lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.network.neutron [req-4a6134c9-c1bb-4ec4-b3e1-853da6f1e37d req-675cadc5-c853-4ad6-b06d-75c38ad470e2 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Refreshing network info cache for port 1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:02:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Start _get_guest_xml network_info=[{"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:02:26 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:26 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1539614270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1539614270',id=16,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3l0CrAp4blgm8p6J/CpMMmsynu7w4Q6ggCy2BAEuQiOvazPWA7Q9HgfC4YOhoX00X2/4A1muPlL6MCNEVU526AcZQkLN/mo9CJfWbPp2gR5FdDgha9mZBUuswKBX7xCA==',key_name='tempest-keypair-591392986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a22155938fca465f904a75e3d0a1bd56',ramdisk_id='',reservation_id='r-yze31y42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1431933072',owner_user_name='tempest-TaggedAttachmentsTest-1431933072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a73caf203ad4e8aaac7a1efb956c048',uuid=a42c3ebd-74a5-4745-a2a8-ade6b5636dc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converting VIF {"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5f:25,bridge_name='br-int',has_traffic_filtering=True,id=1c228670-844c-44a4-ad61-a9982fe910fd,network=Network(d4061bdf-5724-49cb-9b82-a5230c0a6663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c228670-84') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'pci_devices' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:02:26 user nova-compute[72178]:   <uuid>a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</uuid>
Aug 01 12:02:26 user nova-compute[72178]:   <name>instance-00000010</name>
Aug 01 12:02:26 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:02:26 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:02:26 user nova-compute[72178]:   <metadata>
Aug 01 12:02:26 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:02:26 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:02:26 user nova-compute[72178]:       <nova:name>tempest-device-tagging-server-1539614270</nova:name>
Aug 01 12:02:26 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:02:26</nova:creationTime>
Aug 01 12:02:26 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:02:26 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:02:26 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:02:26 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:02:26 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:02:26 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:02:26 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:02:26 user nova-compute[72178]:       <nova:owner>
Aug 01 12:02:26 user nova-compute[72178]:         <nova:user uuid="7a73caf203ad4e8aaac7a1efb956c048">tempest-TaggedAttachmentsTest-1431933072-project-member</nova:user>
Aug 01 12:02:26 user nova-compute[72178]:         <nova:project uuid="a22155938fca465f904a75e3d0a1bd56">tempest-TaggedAttachmentsTest-1431933072</nova:project>
Aug 01 12:02:26 user nova-compute[72178]:       </nova:owner>
Aug 01 12:02:26 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:02:26 user nova-compute[72178]:       <nova:ports>
Aug 01 12:02:26 user nova-compute[72178]:         <nova:port uuid="1c228670-844c-44a4-ad61-a9982fe910fd">
Aug 01 12:02:26 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:02:26 user nova-compute[72178]:         </nova:port>
Aug 01 12:02:26 user nova-compute[72178]:       </nova:ports>
Aug 01 12:02:26 user nova-compute[72178]:     </nova:instance>
Aug 01 12:02:26 user nova-compute[72178]:   </metadata>
Aug 01 12:02:26 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:02:26 user nova-compute[72178]:     <system>
Aug 01 12:02:26 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:02:26 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:02:26 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:02:26 user nova-compute[72178]:       <entry name="serial">a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</entry>
Aug 01 12:02:26 user nova-compute[72178]:       <entry name="uuid">a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</entry>
Aug 01 12:02:26 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:02:26 user nova-compute[72178]:     </system>
Aug 01 12:02:26 user nova-compute[72178]:   </sysinfo>
Aug 01 12:02:26 user nova-compute[72178]:   <os>
Aug 01 12:02:26 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:02:26 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:02:26 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:02:26 user nova-compute[72178]:   </os>
Aug 01 12:02:26 user nova-compute[72178]:   <features>
Aug 01 12:02:26 user nova-compute[72178]:     <acpi/>
Aug 01 12:02:26 user nova-compute[72178]:     <apic/>
Aug 01 12:02:26 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:02:26 user nova-compute[72178]:   </features>
Aug 01 12:02:26 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:02:26 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:02:26 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:02:26 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:02:26 user nova-compute[72178]:   </clock>
Aug 01 12:02:26 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:02:26 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:02:26 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:02:26 user nova-compute[72178]:   </cpu>
Aug 01 12:02:26 user nova-compute[72178]:   <devices>
Aug 01 12:02:26 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:02:26 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:02:26 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk"/>
Aug 01 12:02:26 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:02:26 user nova-compute[72178]:     </disk>
Aug 01 12:02:26 user nova-compute[72178]:     <disk type="file" device="cdrom">
Aug 01 12:02:26 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 12:02:26 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.config"/>
Aug 01 12:02:26 user nova-compute[72178]:       <target dev="hda" bus="ide"/>
Aug 01 12:02:26 user nova-compute[72178]:     </disk>
Aug 01 12:02:26 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:02:26 user nova-compute[72178]:       <mac address="fa:16:3e:66:5f:25"/>
Aug 01 12:02:26 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:02:26 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:02:26 user nova-compute[72178]:       <target dev="tap1c228670-84"/>
Aug 01 12:02:26 user nova-compute[72178]:     </interface>
Aug 01 12:02:26 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:02:26 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/console.log" append="off"/>
Aug 01 12:02:26 user nova-compute[72178]:     </serial>
Aug 01 12:02:26 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:02:26 user nova-compute[72178]:     <video>
Aug 01 12:02:26 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:02:26 user nova-compute[72178]:     </video>
Aug 01 12:02:26 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:02:26 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:02:26 user nova-compute[72178]:     </rng>
Aug 01 12:02:26 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:02:26 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:02:26 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:02:26 user nova-compute[72178]:     </memballoon>
Aug 01 12:02:26 user nova-compute[72178]:   </devices>
Aug 01 12:02:26 user nova-compute[72178]: </domain>
Aug 01 12:02:26 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1539614270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1539614270',id=16,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3l0CrAp4blgm8p6J/CpMMmsynu7w4Q6ggCy2BAEuQiOvazPWA7Q9HgfC4YOhoX00X2/4A1muPlL6MCNEVU526AcZQkLN/mo9CJfWbPp2gR5FdDgha9mZBUuswKBX7xCA==',key_name='tempest-keypair-591392986',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a22155938fca465f904a75e3d0a1bd56',ramdisk_id='',reservation_id='r-yze31y42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1431933072',owner_user_name='tempest-TaggedAttachmentsTest-1431933072-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a73caf203ad4e8aaac7a1efb956c048',uuid=a42c3ebd-74a5-4745-a2a8-ade6b5636dc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converting VIF {"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5f:25,bridge_name='br-int',has_traffic_filtering=True,id=1c228670-844c-44a4-ad61-a9982fe910fd,network=Network(d4061bdf-5724-49cb-9b82-a5230c0a6663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c228670-84') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG os_vif [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5f:25,bridge_name='br-int',has_traffic_filtering=True,id=1c228670-844c-44a4-ad61-a9982fe910fd,network=Network(d4061bdf-5724-49cb-9b82-a5230c0a6663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c228670-84') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c228670-84, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c228670-84, col_values=(('external_ids', {'iface-id': '1c228670-844c-44a4-ad61-a9982fe910fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:5f:25', 'vm-uuid': 'a42c3ebd-74a5-4745-a2a8-ade6b5636dc4'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:26 user nova-compute[72178]: INFO os_vif [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5f:25,bridge_name='br-int',has_traffic_filtering=True,id=1c228670-844c-44a4-ad61-a9982fe910fd,network=Network(d4061bdf-5724-49cb-9b82-a5230c0a6663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c228670-84')
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No BDM found with device name hda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No VIF found with MAC fa:16:3e:66:5f:25, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:02:26 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Using config drive
Aug 01 12:02:26 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Creating config drive at /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.config
Aug 01 12:02:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplhxkz8wt {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplhxkz8wt" returned: 0 in 0.056s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.network.neutron [req-4a6134c9-c1bb-4ec4-b3e1-853da6f1e37d req-675cadc5-c853-4ad6-b06d-75c38ad470e2 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updated VIF entry in instance network info cache for port 1c228670-844c-44a4-ad61-a9982fe910fd. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG nova.network.neutron [req-4a6134c9-c1bb-4ec4-b3e1-853da6f1e37d req-675cadc5-c853-4ad6-b06d-75c38ad470e2 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating instance_info_cache with network_info: [{"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4a6134c9-c1bb-4ec4-b3e1-853da6f1e37d req-675cadc5-c853-4ad6-b06d-75c38ad470e2 service nova] Releasing lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-ae9c519e-9c53-4f2c-b5ee-f303cbdcacc8 req-c87a2c5d-d0bd-4673-b658-37067cef4849 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ae9c519e-9c53-4f2c-b5ee-f303cbdcacc8 req-c87a2c5d-d0bd-4673-b658-37067cef4849 service nova] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ae9c519e-9c53-4f2c-b5ee-f303cbdcacc8 req-c87a2c5d-d0bd-4673-b658-37067cef4849 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ae9c519e-9c53-4f2c-b5ee-f303cbdcacc8 req-c87a2c5d-d0bd-4673-b658-37067cef4849 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-ae9c519e-9c53-4f2c-b5ee-f303cbdcacc8 req-c87a2c5d-d0bd-4673-b658-37067cef4849 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] No waiting events found dispatching network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:27 user nova-compute[72178]: WARNING nova.compute.manager [req-ae9c519e-9c53-4f2c-b5ee-f303cbdcacc8 req-c87a2c5d-d0bd-4673-b658-37067cef4849 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received unexpected event network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd for instance with vm_state building and task_state spawning.
Aug 01 12:02:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:02:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891349.9234633, a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:29 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] VM Resumed (Lifecycle Event)
Aug 01 12:02:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:29 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Instance spawned successfully.
Aug 01 12:02:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:02:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-15abae5e-9535-4b32-9b72-a258266ed3de req-5f75bf76-944d-4417-8570-e5b536662ad6 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-15abae5e-9535-4b32-9b72-a258266ed3de req-5f75bf76-944d-4417-8570-e5b536662ad6 service nova] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-15abae5e-9535-4b32-9b72-a258266ed3de req-5f75bf76-944d-4417-8570-e5b536662ad6 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-15abae5e-9535-4b32-9b72-a258266ed3de req-5f75bf76-944d-4417-8570-e5b536662ad6 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-15abae5e-9535-4b32-9b72-a258266ed3de req-5f75bf76-944d-4417-8570-e5b536662ad6 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] No waiting events found dispatching network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:30 user nova-compute[72178]: WARNING nova.compute.manager [req-15abae5e-9535-4b32-9b72-a258266ed3de req-5f75bf76-944d-4417-8570-e5b536662ad6 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received unexpected event network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd for instance with vm_state building and task_state spawning.
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:02:30 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891349.9276423, a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:30 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] VM Started (Lifecycle Event)
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:02:30 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:02:30 user nova-compute[72178]: INFO nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Took 6.16 seconds to spawn the instance on the hypervisor.
Aug 01 12:02:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:30 user nova-compute[72178]: INFO nova.compute.manager [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Took 7.03 seconds to build instance.
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c3e12ae2-d1b0-43e3-9878-705f228073ff tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.124s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:33 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:33 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7279MB free_disk=25.53842544555664GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 686d22d8-fae6-4035-aeac-c80cbeaff08b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance ddde3963-45a3-4c13-9a58-134d87babeaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 98d39c47-5233-40b1-8d34-af244719fe52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a742f6ab-310e-4652-968d-7840febae699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:02:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updating instance_info_cache with network_info: [{"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:36 user nova-compute[72178]: INFO nova.compute.manager [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Unshelving
Aug 01 12:02:36 user nova-compute[72178]: INFO nova.virt.block_device [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Booting with volume 5545054f-c063-4ef2-a15e-30f1140065d3 at /dev/vdc
Aug 01 12:02:36 user nova-compute[72178]: DEBUG os_brick.utils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[41981b11-72a0-4ff1-a738-354c7b789d2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d39fa5-52cf-4e38-81e1-94bc2d32c112]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6c8539-61cb-4ec6-b710-c1df86c4df43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[979dc64f-99e2-4e9c-bc8b-baecb9f276d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:36 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:02:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[60562696-8ac7-49c4-9f99-d87e0dbb6497]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG os_brick.utils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating existing volume attachment record: 1e8fab3f-6efa-4c70-a214-69ccbec4cb01 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:02:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG nova.objects.instance [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'flavor' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'flavor' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.180s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:37 user nova-compute[72178]: INFO nova.compute.manager [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Attaching volume 21d59707-274c-4ee8-9683-59ccd60abb09 to /dev/vdb
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:38 user nova-compute[72178]: INFO nova.compute.manager [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Attaching volume b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a to /dev/vdb
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.utils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4691f85-56d8-4a53-aaf2-af7c12c0ef74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb234f48-5994-45b5-97dd-38b00a87d833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e1778f-4d78-4a84-9080-7de46d741901]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbfd521-fc5e-4df3-8a33-18f606f1022b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.utils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecccae6c-60f1-4038-b908-4fec67e4ef17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:38 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b26e54-6815-4e79-959e-ae025ef536a5]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.utils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating existing volume attachment record: f9922cd1-3c53-4067-b9af-15a1720806b5 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2df1883-1eb9-45a0-bbe7-775daebd798d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8389874-257b-451e-93ed-d1940672c014]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc2db5c-8d89-4f0a-9671-ae12c3dfc093]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:38 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:02:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0958733a-b3fd-404c-bf2f-ad784bc3d388]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG os_brick.utils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating existing volume attachment record: 4397cf63-1dc3-4aca-a74f-fd5935355e35 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:02:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJUDTwPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:45 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:45 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:45 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[99966bc4-b3c5-4227-802e-44243f3fa141]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:02:45 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c449d7e1-94b2-4a45-a8a4-107a9261f77d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09] added
Aug 01 12:02:45 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4b1e62-b7fa-4fb9-8537-0ef3f1326938]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea425e5d-cafc-43ff-9c03-1419b16f822d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJUDTwPl {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJUDTwPl" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb224fb-04fb-495e-9c49-f8a4b899f0f9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJUDTwPl'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa156765-3f34-4619-9c39-720371b1d69c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c648d3-df25-44ab-87e0-7a42aa346f20]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbzIyFTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:46 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b564c97-f87a-445a-ae65-b6bddcc1ad72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09, portal: 172.16.0.220,3260]
Aug 01 12:02:46 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccbfc46-fe7f-4718-b5a7-393347409ed6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[97955946-4cdf-49b3-bbd5-762a7ab434fa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:46 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:46 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c88c16-4acc-4bd8-b2e2-fcaaf6de0a25]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJUDTwPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG nova.objects.instance [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'flavor' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:46 user nova-compute[72178]: INFO nova.compute.manager [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Attaching volume a06acd6f-2445-445a-98b0-a6811ac35625 to /dev/vdb
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.utils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c5dcbd-9a10-4ffa-93bd-fd0ed35e1e14]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1191f82d-e15a-409e-a95e-1932cafce3c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a12999b-d2dd-447b-80d8-3c459242ed8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d7a666-2b6b-4768-a2f4-0681754ff622]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:46 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:02:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0640b4-75c4-4fff-8125-eaed8f1a2477]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG os_brick.utils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating existing volume attachment record: 900569a0-60ab-4d80-ab2e-52f9b9075526 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:02:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23265393332313834', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265393332313834', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.124s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:47 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:47 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.objects.instance [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'flavor' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef7e04c-eff6-439a-ad0a-4124e74fe6db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:02:47 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bd6689-916e-465d-bf16-1ae20d0c7029]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a] added
Aug 01 12:02:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:02:47 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:02:47 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:02:47 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:02:47 user nova-compute[72178]:   <serial>21d59707-274c-4ee8-9683-59ccd60abb09</serial>
Aug 01 12:02:47 user nova-compute[72178]: </disk>
Aug 01 12:02:47 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74f38f9-5844-4cb5-8ad6-8f8537a877a8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e3875f-2a66-4642-8545-0559d1dd5407]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbzIyFTh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbzIyFTh" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e637c21d-f565-483d-bf89-075b55b11caf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sbzIyFTh'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb51a4-9121-4261-9b71-85676da21992]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'pci_requests' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'numa_topology' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f6f315-3d1d-4e81-b79a-f2b40d10551e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:47 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:47 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:02:47 user nova-compute[72178]: INFO nova.compute.claims [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Claim successful on node user
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ffd461-6edf-40cd-be49-74c958b05108]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260]
Aug 01 12:02:47 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[742fa93b-43c2-443b-87f3-2695b1eb0a41]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaabef92-fda7-456a-9c05-5e7ad4e7afc2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:47 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:47 user nova-compute[72178]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:02:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:47 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:47 user nova-compute[72178]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:02:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f902ca01-4d86-4a42-92cd-f7b5c257244d]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbzIyFTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No VIF found with MAC fa:16:3e:01:b8:ea, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56928013-bcd8-4d1c-ba35-5574d67ae2bf tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.027s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.965s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:48 user nova-compute[72178]: INFO nova.network.neutron [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating port c3d72fdf-8035-4c64-8514-366e8e6b2b51 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== connect_volume: return (2472ms) {'type': 'block', 'scsi_wwn': '26232346633333964', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232346633333964', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'flavor' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:02:48 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:02:48 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:02:48 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:02:48 user nova-compute[72178]:   <serial>b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a</serial>
Aug 01 12:02:48 user nova-compute[72178]: </disk>
Aug 01 12:02:48 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:02:48 user nova-compute[72178]: INFO nova.compute.manager [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Rescuing
Aug 01 12:02:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquired lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No VIF found with MAC fa:16:3e:1a:f9:b8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3696e1b-4f3b-4d19-9144-d2a832803ae3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.202s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:49 user nova-compute[72178]: INFO nova.compute.manager [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Terminating instance
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Releasing lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquired lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-388b79d2-e2ab-4afd-b486-2138a44e0994 req-5e187bb4-e759-48d1-8ef0-c96769d55aef service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-changed-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-388b79d2-e2ab-4afd-b486-2138a44e0994 req-5e187bb4-e759-48d1-8ef0-c96769d55aef service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Refreshing instance network info cache due to event network-changed-c3d72fdf-8035-4c64-8514-366e8e6b2b51. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-388b79d2-e2ab-4afd-b486-2138a44e0994 req-5e187bb4-e759-48d1-8ef0-c96769d55aef service nova] Acquiring lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb7bf6f0-123b-4b49-9fe1-e86bd605b702 req-854803ec-a518-49d2-a3d8-deaea5dc4a25 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received event network-vif-unplugged-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb7bf6f0-123b-4b49-9fe1-e86bd605b702 req-854803ec-a518-49d2-a3d8-deaea5dc4a25 service nova] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb7bf6f0-123b-4b49-9fe1-e86bd605b702 req-854803ec-a518-49d2-a3d8-deaea5dc4a25 service nova] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bb7bf6f0-123b-4b49-9fe1-e86bd605b702 req-854803ec-a518-49d2-a3d8-deaea5dc4a25 service nova] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb7bf6f0-123b-4b49-9fe1-e86bd605b702 req-854803ec-a518-49d2-a3d8-deaea5dc4a25 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] No waiting events found dispatching network-vif-unplugged-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-bb7bf6f0-123b-4b49-9fe1-e86bd605b702 req-854803ec-a518-49d2-a3d8-deaea5dc4a25 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received event network-vif-unplugged-ce5af459-034f-4974-8020-e351fea55ce2 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-7bb02e1f-b426-4b5d-b16b-b902b5ac959c req-d3767ef5-a867-4d10-b484-51f03a0ad2ba service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7bb02e1f-b426-4b5d-b16b-b902b5ac959c req-d3767ef5-a867-4d10-b484-51f03a0ad2ba service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7bb02e1f-b426-4b5d-b16b-b902b5ac959c req-d3767ef5-a867-4d10-b484-51f03a0ad2ba service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7bb02e1f-b426-4b5d-b16b-b902b5ac959c req-d3767ef5-a867-4d10-b484-51f03a0ad2ba service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-7bb02e1f-b426-4b5d-b16b-b902b5ac959c req-d3767ef5-a867-4d10-b484-51f03a0ad2ba service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:49 user nova-compute[72178]: WARNING nova.compute.manager [req-7bb02e1f-b426-4b5d-b16b-b902b5ac959c req-d3767ef5-a867-4d10-b484-51f03a0ad2ba service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state active and task_state rescuing.
Aug 01 12:02:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Releasing lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:02:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Creating image(s)
Aug 01 12:02:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'trusted_certs' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-388b79d2-e2ab-4afd-b486-2138a44e0994 req-5e187bb4-e759-48d1-8ef0-c96769d55aef service nova] Acquired lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-388b79d2-e2ab-4afd-b486-2138a44e0994 req-5e187bb4-e759-48d1-8ef0-c96769d55aef service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Refreshing network info cache for port c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "12578fc8e1dd1d83275da3cc3a8e49432b90690a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "12578fc8e1dd1d83275da3cc3a8e49432b90690a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-4d9483e9-5918-4334-b159-8c165ddf7e1f req-1f9b9ebd-216e-4e05-b116-08413415daf6 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received event network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4d9483e9-5918-4334-b159-8c165ddf7e1f req-1f9b9ebd-216e-4e05-b116-08413415daf6 service nova] Acquiring lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4d9483e9-5918-4334-b159-8c165ddf7e1f req-1f9b9ebd-216e-4e05-b116-08413415daf6 service nova] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4d9483e9-5918-4334-b159-8c165ddf7e1f req-1f9b9ebd-216e-4e05-b116-08413415daf6 service nova] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-4d9483e9-5918-4334-b159-8c165ddf7e1f req-1f9b9ebd-216e-4e05-b116-08413415daf6 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] No waiting events found dispatching network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:52 user nova-compute[72178]: WARNING nova.compute.manager [req-4d9483e9-5918-4334-b159-8c165ddf7e1f req-1f9b9ebd-216e-4e05-b116-08413415daf6 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received unexpected event network-vif-plugged-ce5af459-034f-4974-8020-e351fea55ce2 for instance with vm_state active and task_state deleting.
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-a4b9d58c-9992-43b9-95bc-b10c7a49e067 req-64cbdcf0-7db7-46fc-88fd-7d22113876e8 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a4b9d58c-9992-43b9-95bc-b10c7a49e067 req-64cbdcf0-7db7-46fc-88fd-7d22113876e8 service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a4b9d58c-9992-43b9-95bc-b10c7a49e067 req-64cbdcf0-7db7-46fc-88fd-7d22113876e8 service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a4b9d58c-9992-43b9-95bc-b10c7a49e067 req-64cbdcf0-7db7-46fc-88fd-7d22113876e8 service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-a4b9d58c-9992-43b9-95bc-b10c7a49e067 req-64cbdcf0-7db7-46fc-88fd-7d22113876e8 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:52 user nova-compute[72178]: WARNING nova.compute.manager [req-a4b9d58c-9992-43b9-95bc-b10c7a49e067 req-64cbdcf0-7db7-46fc-88fd-7d22113876e8 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state active and task_state rescuing.
Aug 01 12:02:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Instance destroyed successfully.
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lazy-loading 'resources' on Instance uuid ddde3963-45a3-4c13-9a58-134d87babeaf {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:52 user nova-compute[72178]: INFO nova.compute.manager [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Rebuilding instance
Aug 01 12:02:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance destroyed successfully.
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-424510986',display_name='tempest-TestVolumeSwap-server-424510986',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-424510986',id=10,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeRHp6lcI51HbbQcMViCtaEOMVPIwiZbpOOuW69KRMRwxUN5SbD71ogK9FnPFB/xC43N12nmENS4exUPJyXpGgsaXIfQ/aqUrohgB/U498enroFpQ62J8/aqwLT8Z6yzA==',key_name='tempest-keypair-893721411',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7e5bd7c2af34f1895644736ec2be7ea',ramdisk_id='',reservation_id='r-9ddsi32i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-618136404',owner_user_name='tempest-TestVolumeSwap-618136404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T11:59:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80bcc4418bcd41ed8e58266cfd63d5c9',uuid=ddde3963-45a3-4c13-9a58-134d87babeaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Converting VIF {"id": "ce5af459-034f-4974-8020-e351fea55ce2", "address": "fa:16:3e:13:f6:86", "network": {"id": "2aa1ceb5-f060-458a-ad7c-529e1a87c2eb", "bridge": "br-int", "label": "tempest-TestVolumeSwap-453590958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7e5bd7c2af34f1895644736ec2be7ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce5af459-03", "ovs_interfaceid": "ce5af459-034f-4974-8020-e351fea55ce2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=ce5af459-034f-4974-8020-e351fea55ce2,network=Network(2aa1ceb5-f060-458a-ad7c-529e1a87c2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce5af459-03') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG os_vif [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=ce5af459-034f-4974-8020-e351fea55ce2,network=Network(2aa1ceb5-f060-458a-ad7c-529e1a87c2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce5af459-03') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce5af459-03, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Attempting a stable device rescue
Aug 01 12:02:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:52 user nova-compute[72178]: INFO os_vif [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:f6:86,bridge_name='br-int',has_traffic_filtering=True,id=ce5af459-034f-4974-8020-e351fea55ce2,network=Network(2aa1ceb5-f060-458a-ad7c-529e1a87c2eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce5af459-03')
Aug 01 12:02:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Deleting instance files /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf_del
Aug 01 12:02:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Deletion of /opt/stack/data/nova/instances/ddde3963-45a3-4c13-9a58-134d87babeaf_del complete
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a.part --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.virt.images [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] 39524984-95a7-4bda-99c7-6723a15b99d6 was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a.part /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:52 user nova-compute[72178]: INFO nova.compute.manager [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Took 2.95 seconds to destroy the instance on the hypervisor.
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72178) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance directory exists: not creating {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 12:02:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Creating image(s)
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'trusted_certs' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "fd9d0c53e8a4121de9258c4243b929264f436f5e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "fd9d0c53e8a4121de9258c4243b929264f436f5e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a.part /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a.converted" returned: 0 in 1.235s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'pci_requests' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'pci_devices' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'resources' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'migration_context' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.virt.images [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] 547da481-8b4e-4425-96ae-7e6dc88d0ab8 was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e.part /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72178) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 12:02:53 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Took 1.36 seconds to deallocate network for instance.
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "12578fc8e1dd1d83275da3cc3a8e49432b90690a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.296s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.network.neutron [req-388b79d2-e2ab-4afd-b486-2138a44e0994 req-5e187bb4-e759-48d1-8ef0-c96769d55aef service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updated VIF entry in instance network info cache for port c3d72fdf-8035-4c64-8514-366e8e6b2b51. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG nova.network.neutron [req-388b79d2-e2ab-4afd-b486-2138a44e0994 req-5e187bb4-e759-48d1-8ef0-c96769d55aef service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-388b79d2-e2ab-4afd-b486-2138a44e0994 req-5e187bb4-e759-48d1-8ef0-c96769d55aef service nova] Releasing lock "refresh_cache-a378bfa5-d230-4e81-bc4f-16132501f1df" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "12578fc8e1dd1d83275da3cc3a8e49432b90690a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "12578fc8e1dd1d83275da3cc3a8e49432b90690a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e.part /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e.converted" returned: 0 in 0.435s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-6fb6fa01-7723-4609-8074-93fdcf0e9e09 req-ea91e563-0c3f-4173-b3ec-fb26dddd6300 service nova] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Received event network-vif-deleted-ce5af459-034f-4974-8020-e351fea55ce2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a --force-share --output=json" returned: 0 in 0.249s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a,backing_fmt=raw /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-b0431458-4626-4735-9616-d082f55a0bb7 req-1fac756f-c87c-4b8e-94d9-1333eef88641 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-unplugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b0431458-4626-4735-9616-d082f55a0bb7 req-1fac756f-c87c-4b8e-94d9-1333eef88641 service nova] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b0431458-4626-4735-9616-d082f55a0bb7 req-1fac756f-c87c-4b8e-94d9-1333eef88641 service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b0431458-4626-4735-9616-d082f55a0bb7 req-1fac756f-c87c-4b8e-94d9-1333eef88641 service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-b0431458-4626-4735-9616-d082f55a0bb7 req-1fac756f-c87c-4b8e-94d9-1333eef88641 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] No waiting events found dispatching network-vif-unplugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:54 user nova-compute[72178]: WARNING nova.compute.manager [req-b0431458-4626-4735-9616-d082f55a0bb7 req-1fac756f-c87c-4b8e-94d9-1333eef88641 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received unexpected event network-vif-unplugged-326dc903-e97e-4cde-bd42-5145785c4f92 for instance with vm_state active and task_state rebuilding.
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a,backing_fmt=raw /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk 1073741824" returned: 0 in 0.066s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "12578fc8e1dd1d83275da3cc3a8e49432b90690a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "fd9d0c53e8a4121de9258c4243b929264f436f5e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.879s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "fd9d0c53e8a4121de9258c4243b929264f436f5e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "fd9d0c53e8a4121de9258c4243b929264f436f5e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'migration_context' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:54 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Rebasing disk image.
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e --force-share --output=json" returned: 0 in 0.187s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e,backing_fmt=raw /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e,backing_fmt=raw /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue" returned: 0 in 0.074s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "fd9d0c53e8a4121de9258c4243b929264f436f5e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'migration_context' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:54 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance destroyed successfully.
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Start _get_guest_xml network_info=[{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "vif_mac": "fa:16:3e:01:b8:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '547da481-8b4e-4425-96ae-7e6dc88d0ab8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJUDTwPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '96c961db-b50d-45c9-bc4f-0c594b5a6c2d', 'attached_at': '', 'detached_at': '', 'volume_id': '21d59707-274c-4ee8-9683-59ccd60abb09', 'serial': '21d59707-274c-4ee8-9683-59ccd60abb09'}, 'boot_index': None, 'attachment_id': 'f9922cd1-3c53-4067-b9af-15a1720806b5', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'resources' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.184s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 -F raw /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'numa_topology' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:54 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:54 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'vcpu_model' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:54 user nova-compute[72178]: INFO nova.compute.manager [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Detaching volume b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJUDTwPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:54 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:54 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:54 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ed4daf-e399-4110-a72e-1462bfeed32e]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = zJUDTwPl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 12:02:54 user nova-compute[72178]: node.name = iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09
Aug 01 12:02:54 user nova-compute[72178]: node.tpgt = -1
Aug 01 12:02:54 user nova-compute[72178]: node.startup = automatic
Aug 01 12:02:54 user nova-compute[72178]: node.leading_login = No
Aug 01 12:02:54 user nova-compute[72178]: iface.iscsi_ifacename = default
Aug 01 12:02:54 user nova-compute[72178]: iface.net_ifacename = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.ipaddress = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.prefix_len = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.hwaddress = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.transport_name = tcp
Aug 01 12:02:54 user nova-compute[72178]: iface.initiatorname = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.state = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.vlan_id = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.vlan_priority = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.vlan_state = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.iface_num = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.mtu = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.port = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.bootproto = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.subnet_mask = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.gateway = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.dhcp_alt_client_id = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.dhcp_dns = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.dhcp_learn_iqn = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.dhcp_vendor_id_state = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.dhcp_vendor_id = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.dhcp_slp_da = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.fragmentation = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.gratuitous_arp = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.incoming_forwarding = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.tos_state = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.tos = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.ttl = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.delayed_ack = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.tcp_nagle = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.tcp_wsf_state = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.tcp_wsf = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.tcp_timer_scale = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.tcp_timestamp = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.redirect = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.def_task_mgmt_timeout = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.header_digest = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.data_digest = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.immediate_data = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.initial_r2t = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.data_seq_inorder = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.data_pdu_inorder = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.erl = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.max_receive_data_len = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.first_burst_len = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.max_outstanding_r2t = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.max_burst_len = 0
Aug 01 12:02:54 user nova-compute[72178]: iface.chap_auth = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.bidi_chap = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.strict_login_compliance = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.discovery_auth = <empty>
Aug 01 12:02:54 user nova-compute[72178]: iface.discovery_logout = <empty>
Aug 01 12:02:54 user nova-compute[72178]: node.discovery_address = <empty>
Aug 01 12:02:54 user nova-compute[72178]: node.discovery_port = 0
Aug 01 12:02:54 user nova-compute[72178]: node.discovery_type = static
Aug 01 12:02:54 user nova-compute[72178]: node.session.initial_cmdsn = 0
Aug 01 12:02:54 user nova-compute[72178]: node.session.initial_login_retry_max = 8
Aug 01 12:02:54 user nova-compute[72178]: node.session.xmit_thread_priority = -20
Aug 01 12:02:54 user nova-compute[72178]: node.session.cmds_max = 128
Aug 01 12:02:54 user nova-compute[72178]: node.session.queue_depth = 32
Aug 01 12:02:54 user nova-compute[72178]: node.session.nr_sessions = 1
Aug 01 12:02:54 user nova-compute[72178]: node.session.auth.authmethod = CHAP
Aug 01 12:02:54 user nova-compute[72178]: node.session.auth.username = zJUDTwPl
Aug 01 12:02:54 user nova-compute[72178]: node.session.auth.password = ***
Aug 01 12:02:54 user nova-compute[72178]: node.session.auth.username_in = <empty>
Aug 01 12:02:54 user nova-compute[72178]: node.session.auth.password_in = <empty>
Aug 01 12:02:54 user nova-compute[72178]: node.session.auth.chap_algs = MD5
Aug 01 12:02:54 user nova-compute[72178]: node.session.timeo.replacement_timeout = 120
Aug 01 12:02:54 user nova-compute[72178]: node.session.err_timeo.abort_timeout = 15
Aug 01 12:02:54 user nova-compute[72178]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 12:02:54 user nova-compute[72178]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 12:02:54 user nova-compute[72178]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.FastAbort = Yes
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.InitialR2T = No
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.ImmediateData = Yes
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.MaxConnections = 1
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 12:02:54 user nova-compute[72178]: node.session.iscsi.ERL = 0
Aug 01 12:02:54 user nova-compute[72178]: node.session.scan = manual
Aug 01 12:02:54 user nova-compute[72178]: node.session.reopen_max = 0
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].address = 172.16.0.220
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].port = 3260
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].startup = manual
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].tcp.window_size = 524288
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].tcp.type_of_service = 0
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].timeo.logout_timeout = 15
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].timeo.login_timeout = 15
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].timeo.auth_timeout = 45
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].iscsi.DataDigest = None
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].iscsi.IFMarker = No
Aug 01 12:02:54 user nova-compute[72178]: node.conn[0].iscsi.OFMarker = No
Aug 01 12:02:54 user nova-compute[72178]: # END RECORD
Aug 01 12:02:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.990s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[022b3108-447c-4360-99de-47fc7dda9495]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Deleted allocations for instance ddde3963-45a3-4c13-9a58-134d87babeaf
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c0b17d-74f0-4f28-9f04-170a0f8e1a99]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJUDTwPl {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: INFO nova.virt.block_device [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Attempting to driver detach volume b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a from mountpoint /dev/vdb
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zJUDTwPl" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbb8c4c-debf-4501-92d9-591ccf1b6be7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zJUDTwPl'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Attempting to detach device vdb from instance 84869969-6058-4000-808e-7ccb4ea10aa9 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:02:54 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:02:54 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:02:54 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:02:54 user nova-compute[72178]:   <serial>b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a</serial>
Aug 01 12:02:54 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:02:54 user nova-compute[72178]: </disk>
Aug 01 12:02:54 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1141fc1-81d6-4128-b572-feb964d0b283]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully detached device vdb from instance 84869969-6058-4000-808e-7ccb4ea10aa9 from the persistent domain config.
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbzIyFTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:54 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a9de03-6b32-45e0-b378-e754538f6876]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:54 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:54 user nova-compute[72178]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:02:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:54 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:54 user nova-compute[72178]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:02:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.175s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] HCTL ('34', '0', '0', 0) found on session 12 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[015ced38-bcac-4e4d-9515-c7bba9598cf0]: (4, ('0 0 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Searching for a device in session 12 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJUDTwPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.201s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] <== connect_volume: return (203ms) {'type': 'block', 'scsi_wwn': '23265393332313834', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265393332313834', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.032s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-85e99f82-0474-40e8-92d2-e26dc1dca85b tempest-TestVolumeSwap-618136404 tempest-TestVolumeSwap-618136404-project-member] Lock "ddde3963-45a3-4c13-9a58-134d87babeaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.596s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a9aec8-29ca-4e38-914c-08f4e3114bf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1310442517',display_name='tempest-ServerStableDeviceRescueTest-server-1310442517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1310442517',id=7,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsBmHVnO/9EUTsKC74RMmVO5u+R3m1s7kZbSPz1nI6lkEfrYK4U04WdlnuQWv7muLheKRhVUhUIGufzpGOsl6lv4anSTSZ1rccfsHs4SgBPjx6GjZKQbeEO3plhLWQDiQ==',key_name='tempest-keypair-769995709',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cafcb07520f4031a1902defc1d5a5e0',ramdisk_id='',reservation_id='r-k2jg8hq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-970062569',owner_user_name='tempest-ServerStableDeviceRescueTest-970062569-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='822801b8c40b40b1a49fbdd859575f1a',uuid=96c961db-b50d-45c9-bc4f-0c594b5a6c2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "vif_mac": "fa:16:3e:01:b8:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Converting VIF {"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "vif_mac": "fa:16:3e:01:b8:ea"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:b8:ea,bridge_name='br-int',has_traffic_filtering=True,id=af72e448-83b0-4bec-8ead-79148cc4213c,network=Network(1d9d7786-4cab-410a-a318-cb21f3870443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf72e448-83') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c839ea69-2d1a-47c6-b495-ff46ff8594ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:55 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:55 user nova-compute[72178]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:02:55 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:55 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:55 user nova-compute[72178]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:02:55 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd904126dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:02:55 user nova-compute[72178]:   <uuid>96c961db-b50d-45c9-bc4f-0c594b5a6c2d</uuid>
Aug 01 12:02:55 user nova-compute[72178]:   <name>instance-00000007</name>
Aug 01 12:02:55 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:02:55 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:02:55 user nova-compute[72178]:   <metadata>
Aug 01 12:02:55 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:02:55 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:02:55 user nova-compute[72178]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1310442517</nova:name>
Aug 01 12:02:55 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:02:54</nova:creationTime>
Aug 01 12:02:55 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:02:55 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:02:55 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:02:55 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:02:55 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:02:55 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:02:55 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:02:55 user nova-compute[72178]:       <nova:owner>
Aug 01 12:02:55 user nova-compute[72178]:         <nova:user uuid="822801b8c40b40b1a49fbdd859575f1a">tempest-ServerStableDeviceRescueTest-970062569-project-member</nova:user>
Aug 01 12:02:55 user nova-compute[72178]:         <nova:project uuid="8cafcb07520f4031a1902defc1d5a5e0">tempest-ServerStableDeviceRescueTest-970062569</nova:project>
Aug 01 12:02:55 user nova-compute[72178]:       </nova:owner>
Aug 01 12:02:55 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:02:55 user nova-compute[72178]:       <nova:ports>
Aug 01 12:02:55 user nova-compute[72178]:         <nova:port uuid="af72e448-83b0-4bec-8ead-79148cc4213c">
Aug 01 12:02:55 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 12:02:55 user nova-compute[72178]:         </nova:port>
Aug 01 12:02:55 user nova-compute[72178]:       </nova:ports>
Aug 01 12:02:55 user nova-compute[72178]:     </nova:instance>
Aug 01 12:02:55 user nova-compute[72178]:   </metadata>
Aug 01 12:02:55 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:02:55 user nova-compute[72178]:     <system>
Aug 01 12:02:55 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:02:55 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:02:55 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:02:55 user nova-compute[72178]:       <entry name="serial">96c961db-b50d-45c9-bc4f-0c594b5a6c2d</entry>
Aug 01 12:02:55 user nova-compute[72178]:       <entry name="uuid">96c961db-b50d-45c9-bc4f-0c594b5a6c2d</entry>
Aug 01 12:02:55 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:02:55 user nova-compute[72178]:     </system>
Aug 01 12:02:55 user nova-compute[72178]:   </sysinfo>
Aug 01 12:02:55 user nova-compute[72178]:   <os>
Aug 01 12:02:55 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:02:55 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:02:55 user nova-compute[72178]:   </os>
Aug 01 12:02:55 user nova-compute[72178]:   <features>
Aug 01 12:02:55 user nova-compute[72178]:     <acpi/>
Aug 01 12:02:55 user nova-compute[72178]:     <apic/>
Aug 01 12:02:55 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:02:55 user nova-compute[72178]:   </features>
Aug 01 12:02:55 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:02:55 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:02:55 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:02:55 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:02:55 user nova-compute[72178]:   </clock>
Aug 01 12:02:55 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:02:55 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:02:55 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:02:55 user nova-compute[72178]:   </cpu>
Aug 01 12:02:55 user nova-compute[72178]:   <devices>
Aug 01 12:02:55 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:02:55 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:02:55 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk"/>
Aug 01 12:02:55 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:02:55 user nova-compute[72178]:     </disk>
Aug 01 12:02:55 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:02:55 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:02:55 user nova-compute[72178]:       <source dev="/dev/sdc"/>
Aug 01 12:02:55 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:02:55 user nova-compute[72178]:       <serial>21d59707-274c-4ee8-9683-59ccd60abb09</serial>
Aug 01 12:02:55 user nova-compute[72178]:     </disk>
Aug 01 12:02:55 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:02:55 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:02:55 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue"/>
Aug 01 12:02:55 user nova-compute[72178]:       <target dev="vdc" bus="virtio"/>
Aug 01 12:02:55 user nova-compute[72178]:       <boot order="1"/>
Aug 01 12:02:55 user nova-compute[72178]:     </disk>
Aug 01 12:02:55 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:02:55 user nova-compute[72178]:       <mac address="fa:16:3e:01:b8:ea"/>
Aug 01 12:02:55 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:02:55 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:02:55 user nova-compute[72178]:       <target dev="tapaf72e448-83"/>
Aug 01 12:02:55 user nova-compute[72178]:     </interface>
Aug 01 12:02:55 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:02:55 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/console.log" append="off"/>
Aug 01 12:02:55 user nova-compute[72178]:     </serial>
Aug 01 12:02:55 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:02:55 user nova-compute[72178]:     <video>
Aug 01 12:02:55 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:02:55 user nova-compute[72178]:     </video>
Aug 01 12:02:55 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:02:55 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:02:55 user nova-compute[72178]:     </rng>
Aug 01 12:02:55 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:02:55 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:02:55 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:02:55 user nova-compute[72178]:     </memballoon>
Aug 01 12:02:55 user nova-compute[72178]:   </devices>
Aug 01 12:02:55 user nova-compute[72178]: </domain>
Aug 01 12:02:55 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:55 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance destroyed successfully.
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[04db2fc8-767a-4713-a9dc-83c69192f74b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb7286e-ee06-4304-924e-01fa2da5ae3a]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] No VIF found with MAC fa:16:3e:01:b8:ea, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35c730b-7e72-4257-b36f-78b14dabaa03]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ada6758-cb96-4430-b93c-2e22167138cb]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9b7f1c-225f-4c88-85ef-af63b191494a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1838b4c3-9a92-4a42-9677-67e70acbb14e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260]
Aug 01 12:02:55 user nova-compute[72178]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:55 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[252fcdd4-c7b6-4dbd-8aa5-782dc5630e1e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== disconnect_volume: return (367ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:02:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-d867757e-6065-4f25-babc-90b396e94730 req-a7532cc0-5c6f-4bd2-ac9f-554f0bc083eb service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d867757e-6065-4f25-babc-90b396e94730 req-a7532cc0-5c6f-4bd2-ac9f-554f0bc083eb service nova] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d867757e-6065-4f25-babc-90b396e94730 req-a7532cc0-5c6f-4bd2-ac9f-554f0bc083eb service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d867757e-6065-4f25-babc-90b396e94730 req-a7532cc0-5c6f-4bd2-ac9f-554f0bc083eb service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-d867757e-6065-4f25-babc-90b396e94730 req-a7532cc0-5c6f-4bd2-ac9f-554f0bc083eb service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] No waiting events found dispatching network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:56 user nova-compute[72178]: WARNING nova.compute.manager [req-d867757e-6065-4f25-babc-90b396e94730 req-a7532cc0-5c6f-4bd2-ac9f-554f0bc083eb service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received unexpected event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 for instance with vm_state active and task_state rebuilding.
Aug 01 12:02:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:57 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bdc95c-98c3-4ed7-ae45-b7bcfdae32ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:02:57 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance destroyed successfully.
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2025863266',display_name='tempest-ServerActionsTestOtherA-server-951071372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2025863266',id=3,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-a1thrv1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=84869969-6058-4000-808e-7ccb4ea10aa9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_vif [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap326dc903-e9, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.079s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d6ccac-b95e-473f-b323-c2c0262e236d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625] added
Aug 01 12:02:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: INFO os_vif [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9')
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbzIyFTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.056s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f921d248-abc0-4063-9330-178efcd49ca4]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d8050-d6b8-4a01-93a8-1bef62bd7ced]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKRJbqnS {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKRJbqnS" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[86255d5e-d4fa-489e-8f6f-d63f339c6b33]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKRJbqnS'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[20675d75-01f8-475a-9aa2-3427eec6914f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 -F raw /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk" returned: 0 in 3.001s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Ensure instance console log exists: /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Start _get_guest_xml network_info=[{"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c42c6182f0382c7b8ddc33673274ee9e',container_format='bare',created_at=2023-08-01T12:00:43Z,direct_url=<?>,disk_format='qcow2',id=39524984-95a7-4bda-99c7-6723a15b99d6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1036967952-shelved',owner='41cc7b29110b4871a9b5c6e0328bdd28',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T12:00:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdXbBviW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a378bfa5-d230-4e81-bc4f-16132501f1df', 'attached_at': '', 'detached_at': '', 'volume_id': '5545054f-c063-4ef2-a15e-30f1140065d3', 'serial': '5545054f-c063-4ef2-a15e-30f1140065d3'}, 'boot_index': None, 'attachment_id': '1e8fab3f-6efa-4c70-a214-69ccbec4cb01', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce518d5-38ec-4b3e-87cf-f484fec32c1b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:57 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:57 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c42c6182f0382c7b8ddc33673274ee9e',container_format='bare',created_at=2023-08-01T12:00:43Z,direct_url=<?>,disk_format='qcow2',id=39524984-95a7-4bda-99c7-6723a15b99d6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1036967952-shelved',owner='41cc7b29110b4871a9b5c6e0328bdd28',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-01T12:00:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'vcpu_model' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-3824f418-2314-4396-ae04-ad12ad071064 req-e7ed2253-1d9e-49de-9fd5-2cd285c62f35 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3824f418-2314-4396-ae04-ad12ad071064 req-e7ed2253-1d9e-49de-9fd5-2cd285c62f35 service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3824f418-2314-4396-ae04-ad12ad071064 req-e7ed2253-1d9e-49de-9fd5-2cd285c62f35 service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3824f418-2314-4396-ae04-ad12ad071064 req-e7ed2253-1d9e-49de-9fd5-2cd285c62f35 service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-3824f418-2314-4396-ae04-ad12ad071064 req-e7ed2253-1d9e-49de-9fd5-2cd285c62f35 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:57 user nova-compute[72178]: WARNING nova.compute.manager [req-3824f418-2314-4396-ae04-ad12ad071064 req-e7ed2253-1d9e-49de-9fd5-2cd285c62f35 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state active and task_state rescuing.
Aug 01 12:02:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdXbBviW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb68751-6008-4693-b044-001de47724cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]
Aug 01 12:02:57 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3493878f-3b42-468c-9dae-fad8a85311b0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acc42e7-bb50-4a7d-9350-188159ba6bd4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:57 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:57 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:02:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:57 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:57 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:02:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.564s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[67874cde-043d-4cde-9bdb-1c5a61b4374e]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.610s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== connect_volume: return (1610ms) {'type': 'block', 'scsi_wwn': '23736313333376235', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736313333376235', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.355s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG nova.objects.instance [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'flavor' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef4d6cb-3b23-45f3-a795-32cdec57515c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8edf7d-df67-47ed-a10c-507ec9e63e5e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:58 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:58 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:02:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:58 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:58 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:02:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f42c48b0>, {}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Disconnecting from: [] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.057s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== disconnect_volume: return (1411ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:02:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Deleting instance files /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9_del
Aug 01 12:02:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Deletion of /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9_del complete
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.183s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:58 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:02:58 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:02:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:02:58 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:02:58 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:02:58 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:02:58 user nova-compute[72178]:   <serial>a06acd6f-2445-445a-98b0-a6811ac35625</serial>
Aug 01 12:02:58 user nova-compute[72178]: </disk>
Aug 01 12:02:58 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[821dd60c-947f-4ce7-99cd-9a7bf2407ab5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:02:58 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c683aa-84b3-4da8-a74a-740f5e8dddfd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3] added
Aug 01 12:02:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790798f-a90b-42cd-91ae-a535e4ce41de]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[913632a5-7933-4660-ac73-587703255b2a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdXbBviW {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gdXbBviW" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6078791-c085-4393-b650-2738372fe892]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gdXbBviW'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: INFO nova.virt.block_device [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Booting with volume b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a at /dev/vdb
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb5d5a5-4d6a-44f4-9fff-242f0f384e68]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d305800-5b08-4668-bee9-95f65de2ca10]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.utils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ccf10-6cea-418d-819e-a384846c4748]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3, portal: 172.16.0.220,3260]
Aug 01 12:02:59 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3, portal: 172.16.0.220,3260] successful.
Aug 01 12:02:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33066ee-f67a-487a-a5bb-45572e8a38d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b409dba7-9653-4797-84b7-8712075d06d5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[785077e9-2908-4d0f-b056-706c386414ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f255d448-2f86-488c-887a-94f93266398a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:02:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8554639-7441-4cb1-a15c-edf0bd0d3efd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d36105-73f2-48e4-81d5-c10fc9c09d35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6649cc9e-203b-447b-9f21-a996bd8a2f61]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdXbBviW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:02:59 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[68620175-f791-42c8-822b-69d3444ad6a3]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG os_brick.utils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating existing volume attachment record: eecd74d4-1211-4f9d-8419-69f6137e6dc2 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] No VIF found with MAC fa:16:3e:3b:c9:93, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5cb65b2f-fd3f-483b-b199-7b50dcca70d5 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.863s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-cba47a08-dee6-4901-8346-7c9bc11681e0 req-e8b14f16-8d9d-46f5-b1e7-e827a9b1bc32 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cba47a08-dee6-4901-8346-7c9bc11681e0 req-e8b14f16-8d9d-46f5-b1e7-e827a9b1bc32 service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cba47a08-dee6-4901-8346-7c9bc11681e0 req-e8b14f16-8d9d-46f5-b1e7-e827a9b1bc32 service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cba47a08-dee6-4901-8346-7c9bc11681e0 req-e8b14f16-8d9d-46f5-b1e7-e827a9b1bc32 service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-cba47a08-dee6-4901-8346-7c9bc11681e0 req-e8b14f16-8d9d-46f5-b1e7-e827a9b1bc32 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:02:59 user nova-compute[72178]: WARNING nova.compute.manager [req-cba47a08-dee6-4901-8346-7c9bc11681e0 req-e8b14f16-8d9d-46f5-b1e7-e827a9b1bc32 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state active and task_state rescuing.
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for 96c961db-b50d-45c9-bc4f-0c594b5a6c2d due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891379.8022878, 96c961db-b50d-45c9-bc4f-0c594b5a6c2d => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] VM Resumed (Lifecycle Event)
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f42830a5-396c-4556-a57c-c7f68e6db75e tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:02:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891379.80371, 96c961db-b50d-45c9-bc4f-0c594b5a6c2d => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:02:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] VM Started (Lifecycle Event)
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:02:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] <== connect_volume: return (2562ms) {'type': 'block', 'scsi_wwn': '26235356535663836', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235356535663836', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1036967952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1036967952',id=1,image_ref='39524984-95a7-4bda-99c7-6723a15b99d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-644047153',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-n6me8y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member',shelved_at='2023-08-01T12:00:50.863414',shelved_host='user',shelved_image_id='39524984-95a7-4bda-99c7-6723a15b99d6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=a378bfa5-d230-4e81-bc4f-16132501f1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'pci_devices' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:03:00 user nova-compute[72178]:   <uuid>a378bfa5-d230-4e81-bc4f-16132501f1df</uuid>
Aug 01 12:03:00 user nova-compute[72178]:   <name>instance-00000001</name>
Aug 01 12:03:00 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:03:00 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:03:00 user nova-compute[72178]:   <metadata>
Aug 01 12:03:00 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:03:00 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:03:00 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1036967952</nova:name>
Aug 01 12:03:00 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:02:57</nova:creationTime>
Aug 01 12:03:00 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:03:00 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:03:00 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:03:00 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:03:00 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:03:00 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:03:00 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:03:00 user nova-compute[72178]:       <nova:owner>
Aug 01 12:03:00 user nova-compute[72178]:         <nova:user uuid="435396a1a5f54338a2af729f1e3f1754">tempest-AttachVolumeShelveTestJSON-210279899-project-member</nova:user>
Aug 01 12:03:00 user nova-compute[72178]:         <nova:project uuid="41cc7b29110b4871a9b5c6e0328bdd28">tempest-AttachVolumeShelveTestJSON-210279899</nova:project>
Aug 01 12:03:00 user nova-compute[72178]:       </nova:owner>
Aug 01 12:03:00 user nova-compute[72178]:       <nova:root type="image" uuid="39524984-95a7-4bda-99c7-6723a15b99d6"/>
Aug 01 12:03:00 user nova-compute[72178]:       <nova:ports>
Aug 01 12:03:00 user nova-compute[72178]:         <nova:port uuid="c3d72fdf-8035-4c64-8514-366e8e6b2b51">
Aug 01 12:03:00 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 12:03:00 user nova-compute[72178]:         </nova:port>
Aug 01 12:03:00 user nova-compute[72178]:       </nova:ports>
Aug 01 12:03:00 user nova-compute[72178]:     </nova:instance>
Aug 01 12:03:00 user nova-compute[72178]:   </metadata>
Aug 01 12:03:00 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:03:00 user nova-compute[72178]:     <system>
Aug 01 12:03:00 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:03:00 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:03:00 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:03:00 user nova-compute[72178]:       <entry name="serial">a378bfa5-d230-4e81-bc4f-16132501f1df</entry>
Aug 01 12:03:00 user nova-compute[72178]:       <entry name="uuid">a378bfa5-d230-4e81-bc4f-16132501f1df</entry>
Aug 01 12:03:00 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:03:00 user nova-compute[72178]:     </system>
Aug 01 12:03:00 user nova-compute[72178]:   </sysinfo>
Aug 01 12:03:00 user nova-compute[72178]:   <os>
Aug 01 12:03:00 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:03:00 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:03:00 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:03:00 user nova-compute[72178]:   </os>
Aug 01 12:03:00 user nova-compute[72178]:   <features>
Aug 01 12:03:00 user nova-compute[72178]:     <acpi/>
Aug 01 12:03:00 user nova-compute[72178]:     <apic/>
Aug 01 12:03:00 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:03:00 user nova-compute[72178]:   </features>
Aug 01 12:03:00 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:03:00 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:03:00 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:03:00 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:03:00 user nova-compute[72178]:   </clock>
Aug 01 12:03:00 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:03:00 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:03:00 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:03:00 user nova-compute[72178]:   </cpu>
Aug 01 12:03:00 user nova-compute[72178]:   <devices>
Aug 01 12:03:00 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:03:00 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:03:00 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk"/>
Aug 01 12:03:00 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:03:00 user nova-compute[72178]:     </disk>
Aug 01 12:03:00 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:03:00 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:03:00 user nova-compute[72178]:       <source dev="/dev/sde"/>
Aug 01 12:03:00 user nova-compute[72178]:       <target dev="vdc" bus="virtio"/>
Aug 01 12:03:00 user nova-compute[72178]:       <serial>5545054f-c063-4ef2-a15e-30f1140065d3</serial>
Aug 01 12:03:00 user nova-compute[72178]:     </disk>
Aug 01 12:03:00 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:03:00 user nova-compute[72178]:       <mac address="fa:16:3e:79:57:f2"/>
Aug 01 12:03:00 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:00 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:03:00 user nova-compute[72178]:       <target dev="tapc3d72fdf-80"/>
Aug 01 12:03:00 user nova-compute[72178]:     </interface>
Aug 01 12:03:00 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:03:00 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/console.log" append="off"/>
Aug 01 12:03:00 user nova-compute[72178]:     </serial>
Aug 01 12:03:00 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:03:00 user nova-compute[72178]:     <video>
Aug 01 12:03:00 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:00 user nova-compute[72178]:     </video>
Aug 01 12:03:00 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:03:00 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:03:00 user nova-compute[72178]:     </rng>
Aug 01 12:03:00 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:03:00 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:03:00 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:03:00 user nova-compute[72178]:     </memballoon>
Aug 01 12:03:00 user nova-compute[72178]:   </devices>
Aug 01 12:03:00 user nova-compute[72178]: </domain>
Aug 01 12:03:00 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1036967952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1036967952',id=1,image_ref='39524984-95a7-4bda-99c7-6723a15b99d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-644047153',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-n6me8y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member',shelved_at='2023-08-01T12:00:50.863414',shelved_host='user',shelved_image_id='39524984-95a7-4bda-99c7-6723a15b99d6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=a378bfa5-d230-4e81-bc4f-16132501f1df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG os_vif [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d72fdf-80, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3d72fdf-80, col_values=(('external_ids', {'iface-id': 'c3d72fdf-8035-4c64-8514-366e8e6b2b51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:57:f2', 'vm-uuid': 'a378bfa5-d230-4e81-bc4f-16132501f1df'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:00 user nova-compute[72178]: INFO os_vif [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80')
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No VIF found with MAC fa:16:3e:79:57:f2, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:03:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Stashing vm_state: active {{(pid=72178) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'pci_requests' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:03:02 user nova-compute[72178]: INFO nova.compute.claims [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Claim successful on node user
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'resources' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'pci_devices' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:02 user nova-compute[72178]: INFO nova.compute.resource_tracker [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating resource usage from migration 1d91194a-4719-46bd-a0e6-e42ff9d92795
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-fe0dbb1a-f991-45ce-9320-4f63b51fc50e req-5b00e86b-632b-4bce-bb56-abe1d0b6bba6 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received event network-changed-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-fe0dbb1a-f991-45ce-9320-4f63b51fc50e req-5b00e86b-632b-4bce-bb56-abe1d0b6bba6 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Refreshing instance network info cache due to event network-changed-3a03414e-614f-4b71-9eb7-36948736113c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fe0dbb1a-f991-45ce-9320-4f63b51fc50e req-5b00e86b-632b-4bce-bb56-abe1d0b6bba6 service nova] Acquiring lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fe0dbb1a-f991-45ce-9320-4f63b51fc50e req-5b00e86b-632b-4bce-bb56-abe1d0b6bba6 service nova] Acquired lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.network.neutron [req-fe0dbb1a-f991-45ce-9320-4f63b51fc50e req-5b00e86b-632b-4bce-bb56-abe1d0b6bba6 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Refreshing network info cache for port 3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-5dfb1d87-019d-4488-b11e-43b59643f48c req-b9a74f05-63ae-4d4b-baf9-8f8d20974651 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5dfb1d87-019d-4488-b11e-43b59643f48c req-b9a74f05-63ae-4d4b-baf9-8f8d20974651 service nova] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5dfb1d87-019d-4488-b11e-43b59643f48c req-b9a74f05-63ae-4d4b-baf9-8f8d20974651 service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5dfb1d87-019d-4488-b11e-43b59643f48c req-b9a74f05-63ae-4d4b-baf9-8f8d20974651 service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-5dfb1d87-019d-4488-b11e-43b59643f48c req-b9a74f05-63ae-4d4b-baf9-8f8d20974651 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] No waiting events found dispatching network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:02 user nova-compute[72178]: WARNING nova.compute.manager [req-5dfb1d87-019d-4488-b11e-43b59643f48c req-b9a74f05-63ae-4d4b-baf9-8f8d20974651 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received unexpected event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 12:03:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.828s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:03 user nova-compute[72178]: INFO nova.compute.manager [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Migrating
Aug 01 12:03:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:03:03 user nova-compute[72178]: INFO nova.compute.rpcapi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 01 12:03:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquired lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG nova.network.neutron [req-fe0dbb1a-f991-45ce-9320-4f63b51fc50e req-5b00e86b-632b-4bce-bb56-abe1d0b6bba6 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Updated VIF entry in instance network info cache for port 3a03414e-614f-4b71-9eb7-36948736113c. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG nova.network.neutron [req-fe0dbb1a-f991-45ce-9320-4f63b51fc50e req-5b00e86b-632b-4bce-bb56-abe1d0b6bba6 service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Updating instance_info_cache with network_info: [{"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fe0dbb1a-f991-45ce-9320-4f63b51fc50e req-5b00e86b-632b-4bce-bb56-abe1d0b6bba6 service nova] Releasing lock "refresh_cache-98d39c47-5233-40b1-8d34-af244719fe52" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:03:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Releasing lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Starting migrate_disk_and_power_off {{(pid=72178) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-f0734935-9a7c-480d-bff2-bfacd9ade9d5 req-4d7ea6a6-7ab8-4eeb-a724-89fe3ef6fb0a service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f0734935-9a7c-480d-bff2-bfacd9ade9d5 req-4d7ea6a6-7ab8-4eeb-a724-89fe3ef6fb0a service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f0734935-9a7c-480d-bff2-bfacd9ade9d5 req-4d7ea6a6-7ab8-4eeb-a724-89fe3ef6fb0a service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f0734935-9a7c-480d-bff2-bfacd9ade9d5 req-4d7ea6a6-7ab8-4eeb-a724-89fe3ef6fb0a service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-f0734935-9a7c-480d-bff2-bfacd9ade9d5 req-4d7ea6a6-7ab8-4eeb-a724-89fe3ef6fb0a service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:04 user nova-compute[72178]: WARNING nova.compute.manager [req-f0734935-9a7c-480d-bff2-bfacd9ade9d5 req-4d7ea6a6-7ab8-4eeb-a724-89fe3ef6fb0a service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state active and task_state resize_migrating.
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891384.7074437, a378bfa5-d230-4e81-bc4f-16132501f1df => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:04 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] VM Resumed (Lifecycle Event)
Aug 01 12:03:04 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance spawned successfully.
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-b1583b5e-ddee-47fc-a1ce-582f52c11df8 req-274c5f76-5e60-4c39-9f96-77ef7d40f3cc service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b1583b5e-ddee-47fc-a1ce-582f52c11df8 req-274c5f76-5e60-4c39-9f96-77ef7d40f3cc service nova] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b1583b5e-ddee-47fc-a1ce-582f52c11df8 req-274c5f76-5e60-4c39-9f96-77ef7d40f3cc service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b1583b5e-ddee-47fc-a1ce-582f52c11df8 req-274c5f76-5e60-4c39-9f96-77ef7d40f3cc service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-b1583b5e-ddee-47fc-a1ce-582f52c11df8 req-274c5f76-5e60-4c39-9f96-77ef7d40f3cc service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] No waiting events found dispatching network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:04 user nova-compute[72178]: WARNING nova.compute.manager [req-b1583b5e-ddee-47fc-a1ce-582f52c11df8 req-274c5f76-5e60-4c39-9f96-77ef7d40f3cc service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received unexpected event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 12:03:04 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891384.7075562, a378bfa5-d230-4e81-bc4f-16132501f1df => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:04 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] VM Started (Lifecycle Event)
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:04 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:03:05 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:05 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance destroyed successfully.
Aug 01 12:03:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:03:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-648870079-network", "vif_mac": "fa:16:3e:3b:c9:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-648870079-network", "vif_mac": "fa:16:3e:3b:c9:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_vif [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9f171c-75, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:03:05 user nova-compute[72178]: INFO os_vif [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75')
Aug 01 12:03:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:03:05 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d40f6380-c0e7-4734-ab79-b5e2f2c86b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.871s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e598dc-467c-4b63-96c3-b1b189ea7e2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222de40-dd2d-4415-a2fd-777fb5df40f2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:05 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:05 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:03:05 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:05 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:05 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:05 user nova-compute[72178]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:03:05 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:05 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f412cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d1443d-74da-4e65-801c-be23ddbf7e9f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aee3580-3062-4265-816a-b6a7d8af48f7]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7d127-bc6d-4215-b514-93e0be4c80c3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4def1f40-00bd-4d1c-9628-4fa9e01bb0bc]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcc858e-d9b9-40d5-8403-b16a2563d85a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb9283e-d94c-49b0-abdb-e2b0b0a4a154]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]
Aug 01 12:03:05 user nova-compute[72178]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.
Aug 01 12:03:05 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[27907703-4a52-4d53-92f4-726a03931b1c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== disconnect_volume: return (375ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:03:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8_resize/disk /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "cp -r /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8_resize/disk /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk" returned: 0 in 0.447s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8_resize/disk.info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk.info {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "cp -r /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8_resize/disk.info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk.info" returned: 0 in 0.052s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-83e6bbd5-d735-441c-9627-33d9fb03c922 req-524b5e9f-e434-49c3-9391-f2700871b9bb service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-83e6bbd5-d735-441c-9627-33d9fb03c922 req-524b5e9f-e434-49c3-9391-f2700871b9bb service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-83e6bbd5-d735-441c-9627-33d9fb03c922 req-524b5e9f-e434-49c3-9391-f2700871b9bb service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-83e6bbd5-d735-441c-9627-33d9fb03c922 req-524b5e9f-e434-49c3-9391-f2700871b9bb service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-83e6bbd5-d735-441c-9627-33d9fb03c922 req-524b5e9f-e434-49c3-9391-f2700871b9bb service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:06 user nova-compute[72178]: WARNING nova.compute.manager [req-83e6bbd5-d735-441c-9627-33d9fb03c922 req-524b5e9f-e434-49c3-9391-f2700871b9bb service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state active and task_state resize_migrating.
Aug 01 12:03:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891370.8085322, ddde3963-45a3-4c13-9a58-134d87babeaf => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:07 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] VM Stopped (Lifecycle Event)
Aug 01 12:03:07 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bd717e4d-2161-4543-bb5d-f73043699d48 None None] [instance: ddde3963-45a3-4c13-9a58-134d87babeaf] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG nova.objects.instance [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lazy-loading 'flavor' on Instance uuid 98d39c47-5233-40b1-8d34-af244719fe52 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Port 5f9f171c-75e5-4362-8075-9051f6fbcabe binding to destination host user is already ACTIVE {{(pid=72178) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:07 user nova-compute[72178]: INFO nova.compute.manager [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Attaching volume 8026872a-23c6-455f-a758-bb20a66407b0 to /dev/vdb
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.utils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquired lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e90ab7-f487-4344-93f4-e3b392a3bf8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d189bb5b-45ae-4366-87cc-8bb3df23646b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee4b96b-ad65-4f03-9b27-5c00d81b99a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bed52d6-d13d-49ff-814f-28ba04873d9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:03:08 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[51826c11-e6cb-4fad-9424-a0b8f51cf5f6]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.utils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Updating existing volume attachment record: 15420286-7148-4a9c-94bf-0bbf8ef58af9 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Releasing lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.utils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[841daa47-32b7-4940-a649-96203e4d7886]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5cf0fc-78e7-4ed1-ab3f-e474eab8e610]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78ce4b7-339a-4104-970f-4d3648870e66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10e370c-878d-4d74-8aa3-1daf93fc3f9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:03:08 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:03:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[709d0159-b871-4a47-bc7d-ab363ab7242f]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:03:08 user nova-compute[72178]: DEBUG os_brick.utils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:03:09 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Creating image(s)
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.176s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891374.5227883, 84869969-6058-4000-808e-7ccb4ea10aa9 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:09 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] VM Stopped (Lifecycle Event)
Aug 01 12:03:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-127cc6da-43c0-460c-9403-b814212ede41 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk 1073741824" returned: 0 in 0.054s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.198s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:03:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Cannot resize image /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Ensure instance console log exists: /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Start _get_guest_xml network_info=[{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbzIyFTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84869969-6058-4000-808e-7ccb4ea10aa9', 'attached_at': '', 'detached_at': '', 'volume_id': 'b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a', 'serial': 'b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'}, 'boot_index': None, 'attachment_id': 'eecd74d4-1211-4f9d-8419-69f6137e6dc2', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:03:10 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 12:03:10 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbzIyFTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:03:10 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:10 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:10 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3e33d8-c9a1-4dad-883d-9c63baa0fd32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:03:10 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.042s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[237410ca-958e-4d49-b5e1-c6d7012905dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a] added
Aug 01 12:03:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fd74ad-b93d-49c3-9e2f-4a5902252ef2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[12967db5-1034-4660-9a37-eeeb05948bc0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbzIyFTh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbzIyFTh" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9078b-2001-4f65-bec7-d7be9d726790]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sbzIyFTh'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfcb8b1-28c4-4777-8b98-44ba8f2343e9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef40232d-ccc5-484a-91e3-46f6f31589b9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea9fb3f-6e2b-4243-b118-1e2c229d47b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260]
Aug 01 12:03:10 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260] successful.
Aug 01 12:03:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7491b53b-03bb-4e5f-b1f7-8930870f41bb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5172d9a2-b129-4584-bf94-d2747cbce602]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:10 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be11b0f-5d07-4824-acc0-27e4daef2e9e]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:03:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbzIyFTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26232346633333964', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232346633333964', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T11:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2025863266',display_name='tempest-ServerActionsTestOtherA-server-951071372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2025863266',id=3,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-a1thrv1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=84869969-6058-4000-808e-7ccb4ea10aa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:03:11 user nova-compute[72178]:   <uuid>84869969-6058-4000-808e-7ccb4ea10aa9</uuid>
Aug 01 12:03:11 user nova-compute[72178]:   <name>instance-00000003</name>
Aug 01 12:03:11 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:03:11 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:03:11 user nova-compute[72178]:   <metadata>
Aug 01 12:03:11 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:03:11 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:03:11 user nova-compute[72178]:       <nova:name>tempest-ServerActionsTestOtherA-server-951071372</nova:name>
Aug 01 12:03:11 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:03:10</nova:creationTime>
Aug 01 12:03:11 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:03:11 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:03:11 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:03:11 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:03:11 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:03:11 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:03:11 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:03:11 user nova-compute[72178]:       <nova:owner>
Aug 01 12:03:11 user nova-compute[72178]:         <nova:user uuid="5bc4265e5e5a4c50b76f755a048af7b4">tempest-ServerActionsTestOtherA-709464081-project-member</nova:user>
Aug 01 12:03:11 user nova-compute[72178]:         <nova:project uuid="c4c619872deb42eca689576a995b252e">tempest-ServerActionsTestOtherA-709464081</nova:project>
Aug 01 12:03:11 user nova-compute[72178]:       </nova:owner>
Aug 01 12:03:11 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:03:11 user nova-compute[72178]:       <nova:ports>
Aug 01 12:03:11 user nova-compute[72178]:         <nova:port uuid="326dc903-e97e-4cde-bd42-5145785c4f92">
Aug 01 12:03:11 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 12:03:11 user nova-compute[72178]:         </nova:port>
Aug 01 12:03:11 user nova-compute[72178]:       </nova:ports>
Aug 01 12:03:11 user nova-compute[72178]:     </nova:instance>
Aug 01 12:03:11 user nova-compute[72178]:   </metadata>
Aug 01 12:03:11 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:03:11 user nova-compute[72178]:     <system>
Aug 01 12:03:11 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:03:11 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:03:11 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:03:11 user nova-compute[72178]:       <entry name="serial">84869969-6058-4000-808e-7ccb4ea10aa9</entry>
Aug 01 12:03:11 user nova-compute[72178]:       <entry name="uuid">84869969-6058-4000-808e-7ccb4ea10aa9</entry>
Aug 01 12:03:11 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:03:11 user nova-compute[72178]:     </system>
Aug 01 12:03:11 user nova-compute[72178]:   </sysinfo>
Aug 01 12:03:11 user nova-compute[72178]:   <os>
Aug 01 12:03:11 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:03:11 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:03:11 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:03:11 user nova-compute[72178]:   </os>
Aug 01 12:03:11 user nova-compute[72178]:   <features>
Aug 01 12:03:11 user nova-compute[72178]:     <acpi/>
Aug 01 12:03:11 user nova-compute[72178]:     <apic/>
Aug 01 12:03:11 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:03:11 user nova-compute[72178]:   </features>
Aug 01 12:03:11 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:03:11 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:03:11 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:03:11 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:03:11 user nova-compute[72178]:   </clock>
Aug 01 12:03:11 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:03:11 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:03:11 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:03:11 user nova-compute[72178]:   </cpu>
Aug 01 12:03:11 user nova-compute[72178]:   <devices>
Aug 01 12:03:11 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:03:11 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:03:11 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk"/>
Aug 01 12:03:11 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:03:11 user nova-compute[72178]:     </disk>
Aug 01 12:03:11 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:03:11 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:03:11 user nova-compute[72178]:       <source dev="/dev/sdd"/>
Aug 01 12:03:11 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:03:11 user nova-compute[72178]:       <serial>b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a</serial>
Aug 01 12:03:11 user nova-compute[72178]:     </disk>
Aug 01 12:03:11 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:03:11 user nova-compute[72178]:       <mac address="fa:16:3e:1a:f9:b8"/>
Aug 01 12:03:11 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:11 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:03:11 user nova-compute[72178]:       <target dev="tap326dc903-e9"/>
Aug 01 12:03:11 user nova-compute[72178]:     </interface>
Aug 01 12:03:11 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:03:11 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/console.log" append="off"/>
Aug 01 12:03:11 user nova-compute[72178]:     </serial>
Aug 01 12:03:11 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:03:11 user nova-compute[72178]:     <video>
Aug 01 12:03:11 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:11 user nova-compute[72178]:     </video>
Aug 01 12:03:11 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:03:11 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:03:11 user nova-compute[72178]:     </rng>
Aug 01 12:03:11 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:03:11 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:03:11 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:03:11 user nova-compute[72178]:     </memballoon>
Aug 01 12:03:11 user nova-compute[72178]:   </devices>
Aug 01 12:03:11 user nova-compute[72178]: </domain>
Aug 01 12:03:11 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T11:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2025863266',display_name='tempest-ServerActionsTestOtherA-server-951071372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2025863266',id=3,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-a1thrv1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=84869969-6058-4000-808e-7ccb4ea10aa9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG os_vif [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap326dc903-e9, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap326dc903-e9, col_values=(('external_ids', {'iface-id': '326dc903-e97e-4cde-bd42-5145785c4f92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:f9:b8', 'vm-uuid': '84869969-6058-4000-808e-7ccb4ea10aa9'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:11 user nova-compute[72178]: INFO os_vif [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9')
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No VIF found with MAC fa:16:3e:1a:f9:b8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:03:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-c70975ae-43c6-4c58-b03f-bf27dc736a41 req-64a31a03-d7f4-40a0-83da-25d468560a06 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c70975ae-43c6-4c58-b03f-bf27dc736a41 req-64a31a03-d7f4-40a0-83da-25d468560a06 service nova] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c70975ae-43c6-4c58-b03f-bf27dc736a41 req-64a31a03-d7f4-40a0-83da-25d468560a06 service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c70975ae-43c6-4c58-b03f-bf27dc736a41 req-64a31a03-d7f4-40a0-83da-25d468560a06 service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-c70975ae-43c6-4c58-b03f-bf27dc736a41 req-64a31a03-d7f4-40a0-83da-25d468560a06 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] No waiting events found dispatching network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:13 user nova-compute[72178]: WARNING nova.compute.manager [req-c70975ae-43c6-4c58-b03f-bf27dc736a41 req-64a31a03-d7f4-40a0-83da-25d468560a06 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received unexpected event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 12:03:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-6a0ee4a6-0c6b-45fe-8e5e-1bc98fc41eae req-9f08682f-8380-41a4-9eb0-11ea0d5d7c7b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6a0ee4a6-0c6b-45fe-8e5e-1bc98fc41eae req-9f08682f-8380-41a4-9eb0-11ea0d5d7c7b service nova] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6a0ee4a6-0c6b-45fe-8e5e-1bc98fc41eae req-9f08682f-8380-41a4-9eb0-11ea0d5d7c7b service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6a0ee4a6-0c6b-45fe-8e5e-1bc98fc41eae req-9f08682f-8380-41a4-9eb0-11ea0d5d7c7b service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-6a0ee4a6-0c6b-45fe-8e5e-1bc98fc41eae req-9f08682f-8380-41a4-9eb0-11ea0d5d7c7b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] No waiting events found dispatching network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:15 user nova-compute[72178]: WARNING nova.compute.manager [req-6a0ee4a6-0c6b-45fe-8e5e-1bc98fc41eae req-9f08682f-8380-41a4-9eb0-11ea0d5d7c7b service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received unexpected event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 for instance with vm_state active and task_state rebuild_spawning.
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891395.7506282, 84869969-6058-4000-808e-7ccb4ea10aa9 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:15 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] VM Resumed (Lifecycle Event)
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:03:15 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance spawned successfully.
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:03:15 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891395.7555728, 84869969-6058-4000-808e-7ccb4ea10aa9 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:15 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] VM Started (Lifecycle Event)
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:15 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 12:03:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:16 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72178) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 12:03:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e2b675e-f493-4093-8785-16ac6eb105c2 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpBitSfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:03:17 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:17 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:17 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f247da-f788-4ec3-9473-0e61ef970d2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:03:17 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6681a94d-6501-41b2-80b9-4418fa0d92a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0] added
Aug 01 12:03:17 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a295a284-a265-47af-a081-8fdb9af7dc80]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9023da09-0f06-4934-ad06-969d8fcc227b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpBitSfG {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpBitSfG" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d850953-b07d-4a57-afa2-bc11d5caed56]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpBitSfG'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3436104f-441c-41da-971b-3227f0ebc8e6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a409ca25-1011-47a1-91aa-9f8532e1a37f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:17 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:17 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63ec976-a432-4133-879a-bd420b2f1a59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0, portal: 172.16.0.220,3260]
Aug 01 12:03:17 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0, portal: 172.16.0.220,3260] successful.
Aug 01 12:03:17 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99f8c66-88eb-4764-8b30-ba0ec4db3e13]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ade0a5d-d849-471d-a146-e1f238f3089e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:17 user nova-compute[72178]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)
Aug 01 12:03:17 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[585f2367-89e8-4b59-b1ae-512e83bbb5a9]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:03:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpBitSfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Starting finish_migration {{(pid=72178) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance directory exists: not creating {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 12:03:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Creating image(s)
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'trusted_certs' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk. size=21474836480 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk 21474836480 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk 21474836480" returned: 0 in 0.064s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Ensure instance console log exists: /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Start _get_guest_xml network_info=[{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-648870079-network", "vif_mac": "fa:16:3e:3b:c9:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f75a07e7-7cd8-4a63-b03d-422e07da25f8', 'attached_at': '2023-08-01T12:03:18.000000', 'detached_at': '', 'volume_id': 'a06acd6f-2445-445a-98b0-a6811ac35625', 'serial': 'a06acd6f-2445-445a-98b0-a6811ac35625'}, 'boot_index': None, 'attachment_id': '65c426e0-e43d-42de-a344-572de82f9307', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:03:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:03:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'vcpu_model' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:03:18 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:03:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23930363363346537', 'path': '/dev/sdf'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930363363346537', 'path': '/dev/sdf'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.081s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:18 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:03:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:18 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lazy-loading 'flavor' on Instance uuid 98d39c47-5233-40b1-8d34-af244719fe52 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42098c0-15ac-41bd-90d7-a0c46da913df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:03:18 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:03:19 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:03:19 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:03:19 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:03:19 user nova-compute[72178]:   <serial>8026872a-23c6-455f-a758-bb20a66407b0</serial>
Aug 01 12:03:19 user nova-compute[72178]: </disk>
Aug 01 12:03:19 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e9f90-3a0e-431d-bb44-06a38b92e1f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625] added
Aug 01 12:03:19 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6d3dfe-d891-47f4-9647-9283e445c5af]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e9fd06-d56a-4652-8ce3-eb5b990d1147]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKRJbqnS {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKRJbqnS" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12a8b4d-828f-403d-ae49-ff9c78bc3f83]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKRJbqnS'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d634c569-6956-49f8-9e2b-7ce791428b77]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91c355a-0700-4700-aeed-173138bca48a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e88846a-bcf5-4119-8f6b-c9f1d3fb86b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]
Aug 01 12:03:19 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.
Aug 01 12:03:19 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f3face-9ed3-4c52-8484-2d89ca1052c7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1ae505-df95-4620-b03b-110d80d95cc8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:03:19 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf10dc-c6dc-48a2-a07e-cd9a3768acd9]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] No VIF found with MAC fa:16:3e:b9:49:3a, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:03:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ee79954c-5e70-461e-8013-692d35e49818 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.660s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891385.106779, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:20 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Stopped (Lifecycle Event)
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1f3b1e82-283c-443f-81b9-8c69d3a1fd06 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1f3b1e82-283c-443f-81b9-8c69d3a1fd06 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:20 user nova-compute[72178]: INFO nova.compute.manager [None req-1f3b1e82-283c-443f-81b9-8c69d3a1fd06 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 12:03:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== connect_volume: return (1521ms) {'type': 'block', 'scsi_wwn': '23736313333376235', 'path': '/dev/sdg'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736313333376235', 'path': '/dev/sdg'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-648870079-network", "vif_mac": "fa:16:3e:3b:c9:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-648870079-network", "vif_mac": "fa:16:3e:3b:c9:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:03:20 user nova-compute[72178]:   <uuid>f75a07e7-7cd8-4a63-b03d-422e07da25f8</uuid>
Aug 01 12:03:20 user nova-compute[72178]:   <name>instance-00000008</name>
Aug 01 12:03:20 user nova-compute[72178]:   <memory>2097152</memory>
Aug 01 12:03:20 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:03:20 user nova-compute[72178]:   <metadata>
Aug 01 12:03:20 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:03:20 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:03:20 user nova-compute[72178]:       <nova:name>tempest-ServerActionsTestOtherB-server-1304452031</nova:name>
Aug 01 12:03:20 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:03:18</nova:creationTime>
Aug 01 12:03:20 user nova-compute[72178]:       <nova:flavor name="m1.small">
Aug 01 12:03:20 user nova-compute[72178]:         <nova:memory>2048</nova:memory>
Aug 01 12:03:20 user nova-compute[72178]:         <nova:disk>20</nova:disk>
Aug 01 12:03:20 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:03:20 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:03:20 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:03:20 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:03:20 user nova-compute[72178]:       <nova:owner>
Aug 01 12:03:20 user nova-compute[72178]:         <nova:user uuid="57295306c0f44b0db27c9eb0c3ac8b6b">tempest-ServerActionsTestOtherB-2113691896-project-member</nova:user>
Aug 01 12:03:20 user nova-compute[72178]:         <nova:project uuid="b58e90c2bb974b6a9be977ac0ce46828">tempest-ServerActionsTestOtherB-2113691896</nova:project>
Aug 01 12:03:20 user nova-compute[72178]:       </nova:owner>
Aug 01 12:03:20 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:03:20 user nova-compute[72178]:       <nova:ports>
Aug 01 12:03:20 user nova-compute[72178]:         <nova:port uuid="5f9f171c-75e5-4362-8075-9051f6fbcabe">
Aug 01 12:03:20 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:03:20 user nova-compute[72178]:         </nova:port>
Aug 01 12:03:20 user nova-compute[72178]:       </nova:ports>
Aug 01 12:03:20 user nova-compute[72178]:     </nova:instance>
Aug 01 12:03:20 user nova-compute[72178]:   </metadata>
Aug 01 12:03:20 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:03:20 user nova-compute[72178]:     <system>
Aug 01 12:03:20 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:03:20 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:03:20 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:03:20 user nova-compute[72178]:       <entry name="serial">f75a07e7-7cd8-4a63-b03d-422e07da25f8</entry>
Aug 01 12:03:20 user nova-compute[72178]:       <entry name="uuid">f75a07e7-7cd8-4a63-b03d-422e07da25f8</entry>
Aug 01 12:03:20 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:03:20 user nova-compute[72178]:     </system>
Aug 01 12:03:20 user nova-compute[72178]:   </sysinfo>
Aug 01 12:03:20 user nova-compute[72178]:   <os>
Aug 01 12:03:20 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:03:20 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:03:20 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:03:20 user nova-compute[72178]:   </os>
Aug 01 12:03:20 user nova-compute[72178]:   <features>
Aug 01 12:03:20 user nova-compute[72178]:     <acpi/>
Aug 01 12:03:20 user nova-compute[72178]:     <apic/>
Aug 01 12:03:20 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:03:20 user nova-compute[72178]:   </features>
Aug 01 12:03:20 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:03:20 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:03:20 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:03:20 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:03:20 user nova-compute[72178]:   </clock>
Aug 01 12:03:20 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:03:20 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:03:20 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:03:20 user nova-compute[72178]:   </cpu>
Aug 01 12:03:20 user nova-compute[72178]:   <devices>
Aug 01 12:03:20 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:03:20 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:03:20 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk"/>
Aug 01 12:03:20 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:03:20 user nova-compute[72178]:     </disk>
Aug 01 12:03:20 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:03:20 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:03:20 user nova-compute[72178]:       <source dev="/dev/sdg"/>
Aug 01 12:03:20 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:03:20 user nova-compute[72178]:       <serial>a06acd6f-2445-445a-98b0-a6811ac35625</serial>
Aug 01 12:03:20 user nova-compute[72178]:     </disk>
Aug 01 12:03:20 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:03:20 user nova-compute[72178]:       <mac address="fa:16:3e:3b:c9:93"/>
Aug 01 12:03:20 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:20 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:03:20 user nova-compute[72178]:       <target dev="tap5f9f171c-75"/>
Aug 01 12:03:20 user nova-compute[72178]:     </interface>
Aug 01 12:03:20 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:03:20 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/console.log" append="off"/>
Aug 01 12:03:20 user nova-compute[72178]:     </serial>
Aug 01 12:03:20 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:03:20 user nova-compute[72178]:     <video>
Aug 01 12:03:20 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:20 user nova-compute[72178]:     </video>
Aug 01 12:03:20 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:03:20 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:03:20 user nova-compute[72178]:     </rng>
Aug 01 12:03:20 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:03:20 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:03:20 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:03:20 user nova-compute[72178]:     </memballoon>
Aug 01 12:03:20 user nova-compute[72178]:   </devices>
Aug 01 12:03:20 user nova-compute[72178]: </domain>
Aug 01 12:03:20 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-648870079-network", "vif_mac": "fa:16:3e:3b:c9:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-648870079-network", "vif_mac": "fa:16:3e:3b:c9:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG os_vif [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9f171c-75, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f9f171c-75, col_values=(('external_ids', {'iface-id': '5f9f171c-75e5-4362-8075-9051f6fbcabe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:c9:93', 'vm-uuid': 'f75a07e7-7cd8-4a63-b03d-422e07da25f8'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:20 user nova-compute[72178]: INFO os_vif [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75')
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] No VIF found with MAC fa:16:3e:3b:c9:93, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:03:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:21 user nova-compute[72178]: INFO nova.compute.manager [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Detaching volume 8026872a-23c6-455f-a758-bb20a66407b0
Aug 01 12:03:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:22 user nova-compute[72178]: INFO nova.virt.block_device [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Attempting to driver detach volume 8026872a-23c6-455f-a758-bb20a66407b0 from mountpoint /dev/vdb
Aug 01 12:03:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Attempting to detach device vdb from instance 98d39c47-5233-40b1-8d34-af244719fe52 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:03:22 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:03:22 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:03:22 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:03:22 user nova-compute[72178]:   <serial>8026872a-23c6-455f-a758-bb20a66407b0</serial>
Aug 01 12:03:22 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:03:22 user nova-compute[72178]: </disk>
Aug 01 12:03:22 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:22 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Successfully detached device vdb from instance 98d39c47-5233-40b1-8d34-af244719fe52 from the persistent domain config.
Aug 01 12:03:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98d39c47-5233-40b1-8d34-af244719fe52 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:03:22 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:03:22 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:03:22 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:03:22 user nova-compute[72178]:   <serial>8026872a-23c6-455f-a758-bb20a66407b0</serial>
Aug 01 12:03:22 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:03:22 user nova-compute[72178]: </disk>
Aug 01 12:03:22 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-67d25dce-a3c7-4e1a-80f2-9df277960883 req-004924ce-0820-4ecd-b7a5-4f8c38517a4c service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-67d25dce-a3c7-4e1a-80f2-9df277960883 req-004924ce-0820-4ecd-b7a5-4f8c38517a4c service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-67d25dce-a3c7-4e1a-80f2-9df277960883 req-004924ce-0820-4ecd-b7a5-4f8c38517a4c service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-67d25dce-a3c7-4e1a-80f2-9df277960883 req-004924ce-0820-4ecd-b7a5-4f8c38517a4c service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-67d25dce-a3c7-4e1a-80f2-9df277960883 req-004924ce-0820-4ecd-b7a5-4f8c38517a4c service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:22 user nova-compute[72178]: WARNING nova.compute.manager [req-67d25dce-a3c7-4e1a-80f2-9df277960883 req-004924ce-0820-4ecd-b7a5-4f8c38517a4c service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state active and task_state resize_finish.
Aug 01 12:03:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891403.0113618, 98d39c47-5233-40b1-8d34-af244719fe52 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98d39c47-5233-40b1-8d34-af244719fe52 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:03:23 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Successfully detached device vdb from instance 98d39c47-5233-40b1-8d34-af244719fe52 from the live domain config.
Aug 01 12:03:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpBitSfG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:03:23 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9b2425-6a6e-4c12-abf0-97a326f439ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfd713e-c64c-407e-b40f-485403835d27]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:03:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 (non-flash)
Aug 01 12:03:23 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:03:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f4756290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0'): ({'sdf'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Removing single pathed devices sdf {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc4e15b-9ce8-4cd5-a182-21754bc43c4a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1c935c-2b07-4fa6-9ef8-fc9fb95a365f]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Flushing IO for device /dev/sdf {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9561f3-c1dd-4cc7-9de4-d38354058ff6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e11546f-d0a2-4582-aa0e-321ef8b0f261]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3c91a4-7368-4980-a38a-1c9270e7f629]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[084212d7-06ab-4613-a09e-d96c1888696e]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0, portal: 172.16.0.220,3260]
Aug 01 12:03:23 user nova-compute[72178]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0, portal: 172.16.0.220,3260] successful.
Aug 01 12:03:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8026872a-23c6-455f-a758-bb20a66407b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[faced727-20e2-4483-a9a0-a06d205ad448]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] <== disconnect_volume: return (348ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:03:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lazy-loading 'flavor' on Instance uuid 98d39c47-5233-40b1-8d34-af244719fe52 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10877347-fb79-436a-8171-e90c0345ddb8 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.300s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-991781c8-fc62-42f9-9f29-2d7ad0270e15 req-9916be6c-4ac6-4cf4-8d6d-a72f28fc3b54 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-991781c8-fc62-42f9-9f29-2d7ad0270e15 req-9916be6c-4ac6-4cf4-8d6d-a72f28fc3b54 service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-991781c8-fc62-42f9-9f29-2d7ad0270e15 req-9916be6c-4ac6-4cf4-8d6d-a72f28fc3b54 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-991781c8-fc62-42f9-9f29-2d7ad0270e15 req-9916be6c-4ac6-4cf4-8d6d-a72f28fc3b54 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-991781c8-fc62-42f9-9f29-2d7ad0270e15 req-9916be6c-4ac6-4cf4-8d6d-a72f28fc3b54 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:24 user nova-compute[72178]: WARNING nova.compute.manager [req-991781c8-fc62-42f9-9f29-2d7ad0270e15 req-9916be6c-4ac6-4cf4-8d6d-a72f28fc3b54 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state active and task_state resize_finish.
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891405.0962293, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:25 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Resumed (Lifecycle Event)
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:03:25 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance running successfully.
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Failed to set time: agent not configured {{(pid=72178) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aebbb30c-9a29-43fa-b102-09416bfb52da tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] finish_migration finished successfully. {{(pid=72178) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:25 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891405.0999541, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:25 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Started (Lifecycle Event)
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:25 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 12:03:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:26 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:26 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:03:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:03:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:33 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:03:33 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7175MB free_disk=25.373275756835938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Applying migration context for instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 as it has an incoming, in-progress migration 1d91194a-4719-46bd-a0e6-e42ff9d92795. Migration status is finished {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 12:03:33 user nova-compute[72178]: INFO nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating resource usage from migration 1d91194a-4719-46bd-a0e6-e42ff9d92795
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 686d22d8-fae6-4035-aeac-c80cbeaff08b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 98d39c47-5233-40b1-8d34-af244719fe52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a742f6ab-310e-4652-968d-7840febae699 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a378bfa5-d230-4e81-bc4f-16132501f1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Migration 1d91194a-4719-46bd-a0e6-e42ff9d92795 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:03:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:03:34 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:03:34 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:03:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:03:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:35 user nova-compute[72178]: INFO nova.compute.manager [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Rescuing
Aug 01 12:03:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquired lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updating instance_info_cache with network_info: [{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Releasing lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-03b68e06-557a-4e51-9c7a-a7798c11ad22 req-1f588c8b-6ba6-4bf4-b2f6-12970e86df92 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-03b68e06-557a-4e51-9c7a-a7798c11ad22 req-1f588c8b-6ba6-4bf4-b2f6-12970e86df92 service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-03b68e06-557a-4e51-9c7a-a7798c11ad22 req-1f588c8b-6ba6-4bf4-b2f6-12970e86df92 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-03b68e06-557a-4e51-9c7a-a7798c11ad22 req-1f588c8b-6ba6-4bf4-b2f6-12970e86df92 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-03b68e06-557a-4e51-9c7a-a7798c11ad22 req-1f588c8b-6ba6-4bf4-b2f6-12970e86df92 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:36 user nova-compute[72178]: WARNING nova.compute.manager [req-03b68e06-557a-4e51-9c7a-a7798c11ad22 req-1f588c8b-6ba6-4bf4-b2f6-12970e86df92 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state active and task_state rescuing.
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updating instance_info_cache with network_info: [{"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance destroyed successfully.
Aug 01 12:03:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Attempting rescue
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72178) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance directory exists: not creating {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 12:03:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Creating image(s)
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.rescue {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.rescue" returned: 0 in 0.048s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'migration_context' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Start _get_guest_xml network_info=[{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "vif_mac": "fa:16:3e:fc:7a:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'resources' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:36 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:03:36 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1723458725',display_name='tempest-ServerRescueNegativeTestJSON-server-1723458725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1723458725',id=2,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-rmm0o2wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T11:59:10Z,user_data=None,user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=8ac32412-1f05-4d62-a184-0b90f1b3d21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "vif_mac": "fa:16:3e:fc:7a:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "vif_mac": "fa:16:3e:fc:7a:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:7a:b7,bridge_name='br-int',has_traffic_filtering=True,id=1d37f04c-d365-4720-ace0-73d2cdd79af2,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d37f04c-d3') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:03:36 user nova-compute[72178]:   <uuid>8ac32412-1f05-4d62-a184-0b90f1b3d21c</uuid>
Aug 01 12:03:36 user nova-compute[72178]:   <name>instance-00000002</name>
Aug 01 12:03:36 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:03:36 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:03:36 user nova-compute[72178]:   <metadata>
Aug 01 12:03:36 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:03:36 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:03:36 user nova-compute[72178]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1723458725</nova:name>
Aug 01 12:03:36 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:03:36</nova:creationTime>
Aug 01 12:03:36 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:03:36 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:03:36 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:03:36 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:03:36 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:03:36 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:03:36 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:03:36 user nova-compute[72178]:       <nova:owner>
Aug 01 12:03:36 user nova-compute[72178]:         <nova:user uuid="6f27c80bc14843e6a250f1df6e40f26f">tempest-ServerRescueNegativeTestJSON-1377634293-project-member</nova:user>
Aug 01 12:03:36 user nova-compute[72178]:         <nova:project uuid="ee85194306f544e8be7c1a8d2ba4656c">tempest-ServerRescueNegativeTestJSON-1377634293</nova:project>
Aug 01 12:03:36 user nova-compute[72178]:       </nova:owner>
Aug 01 12:03:36 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:03:36 user nova-compute[72178]:       <nova:ports>
Aug 01 12:03:36 user nova-compute[72178]:         <nova:port uuid="1d37f04c-d365-4720-ace0-73d2cdd79af2">
Aug 01 12:03:36 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 12:03:36 user nova-compute[72178]:         </nova:port>
Aug 01 12:03:36 user nova-compute[72178]:       </nova:ports>
Aug 01 12:03:36 user nova-compute[72178]:     </nova:instance>
Aug 01 12:03:36 user nova-compute[72178]:   </metadata>
Aug 01 12:03:36 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:03:36 user nova-compute[72178]:     <system>
Aug 01 12:03:36 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:03:36 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:03:36 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:03:36 user nova-compute[72178]:       <entry name="serial">8ac32412-1f05-4d62-a184-0b90f1b3d21c</entry>
Aug 01 12:03:36 user nova-compute[72178]:       <entry name="uuid">8ac32412-1f05-4d62-a184-0b90f1b3d21c</entry>
Aug 01 12:03:36 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:03:36 user nova-compute[72178]:     </system>
Aug 01 12:03:36 user nova-compute[72178]:   </sysinfo>
Aug 01 12:03:36 user nova-compute[72178]:   <os>
Aug 01 12:03:36 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:03:36 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:03:36 user nova-compute[72178]:   </os>
Aug 01 12:03:36 user nova-compute[72178]:   <features>
Aug 01 12:03:36 user nova-compute[72178]:     <acpi/>
Aug 01 12:03:36 user nova-compute[72178]:     <apic/>
Aug 01 12:03:36 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:03:36 user nova-compute[72178]:   </features>
Aug 01 12:03:36 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:03:36 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:03:36 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:03:36 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:03:36 user nova-compute[72178]:   </clock>
Aug 01 12:03:36 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:03:36 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:03:36 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:03:36 user nova-compute[72178]:   </cpu>
Aug 01 12:03:36 user nova-compute[72178]:   <devices>
Aug 01 12:03:36 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:03:36 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:03:36 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.rescue"/>
Aug 01 12:03:36 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:03:36 user nova-compute[72178]:     </disk>
Aug 01 12:03:36 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:03:36 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:03:36 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk"/>
Aug 01 12:03:36 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:03:36 user nova-compute[72178]:     </disk>
Aug 01 12:03:36 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:03:36 user nova-compute[72178]:       <mac address="fa:16:3e:fc:7a:b7"/>
Aug 01 12:03:36 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:36 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:03:36 user nova-compute[72178]:       <target dev="tap1d37f04c-d3"/>
Aug 01 12:03:36 user nova-compute[72178]:     </interface>
Aug 01 12:03:36 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:03:36 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/console.log" append="off"/>
Aug 01 12:03:36 user nova-compute[72178]:     </serial>
Aug 01 12:03:36 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:03:36 user nova-compute[72178]:     <video>
Aug 01 12:03:36 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:36 user nova-compute[72178]:     </video>
Aug 01 12:03:36 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:03:36 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:03:36 user nova-compute[72178]:     </rng>
Aug 01 12:03:36 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:03:36 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:03:36 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:03:36 user nova-compute[72178]:     </memballoon>
Aug 01 12:03:36 user nova-compute[72178]:   </devices>
Aug 01 12:03:36 user nova-compute[72178]: </domain>
Aug 01 12:03:36 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:03:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance destroyed successfully.
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No VIF found with MAC fa:16:3e:fc:7a:b7, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:03:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-de58e936-e550-4c9e-a400-cd0e9da5a7cd req-591079cb-bffb-4c46-b974-fcb062b74e3e service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de58e936-e550-4c9e-a400-cd0e9da5a7cd req-591079cb-bffb-4c46-b974-fcb062b74e3e service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de58e936-e550-4c9e-a400-cd0e9da5a7cd req-591079cb-bffb-4c46-b974-fcb062b74e3e service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de58e936-e550-4c9e-a400-cd0e9da5a7cd req-591079cb-bffb-4c46-b974-fcb062b74e3e service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-de58e936-e550-4c9e-a400-cd0e9da5a7cd req-591079cb-bffb-4c46-b974-fcb062b74e3e service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:38 user nova-compute[72178]: WARNING nova.compute.manager [req-de58e936-e550-4c9e-a400-cd0e9da5a7cd req-591079cb-bffb-4c46-b974-fcb062b74e3e service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state active and task_state rescuing.
Aug 01 12:03:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:40 user nova-compute[72178]: WARNING nova.compute.manager [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state active and task_state rescuing.
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:40 user nova-compute[72178]: WARNING nova.compute.manager [req-de3e9466-543c-4bdc-9618-8fec443adc7a req-d0011c8b-96a4-45ed-ae5c-beca2ec8a7ba service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state active and task_state rescuing.
Aug 01 12:03:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for 8ac32412-1f05-4d62-a184-0b90f1b3d21c due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891420.7535443, 8ac32412-1f05-4d62-a184-0b90f1b3d21c => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] VM Resumed (Lifecycle Event)
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-17dd4eaa-80a2-4c05-9f9b-40d65b12b81f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891420.7653153, 8ac32412-1f05-4d62-a184-0b90f1b3d21c => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] VM Started (Lifecycle Event)
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:43 user nova-compute[72178]: INFO nova.compute.manager [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Rescuing
Aug 01 12:03:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:03:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquired lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:03:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:03:44 user nova-compute[72178]: DEBUG nova.network.neutron [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updating instance_info_cache with network_info: [{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:03:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Releasing lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:03:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-b6e492d0-a7bf-4c1b-ad48-1af980df794a req-64a5df22-b6c8-4dc9-8e55-4ab48b719de3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b6e492d0-a7bf-4c1b-ad48-1af980df794a req-64a5df22-b6c8-4dc9-8e55-4ab48b719de3 service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b6e492d0-a7bf-4c1b-ad48-1af980df794a req-64a5df22-b6c8-4dc9-8e55-4ab48b719de3 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b6e492d0-a7bf-4c1b-ad48-1af980df794a req-64a5df22-b6c8-4dc9-8e55-4ab48b719de3 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-b6e492d0-a7bf-4c1b-ad48-1af980df794a req-64a5df22-b6c8-4dc9-8e55-4ab48b719de3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:45 user nova-compute[72178]: WARNING nova.compute.manager [req-b6e492d0-a7bf-4c1b-ad48-1af980df794a req-64a5df22-b6c8-4dc9-8e55-4ab48b719de3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state active and task_state rescuing.
Aug 01 12:03:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance destroyed successfully.
Aug 01 12:03:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Attempting a stable device rescue
Aug 01 12:03:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72178) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance directory exists: not creating {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 12:03:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Creating image(s)
Aug 01 12:03:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "/opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "/opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "b019111ba1a850dd24c26ed34c604f2b6b09a4f0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "b019111ba1a850dd24c26ed34c604f2b6b09a4f0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-d7080289-00d8-4bcf-af18-f6741ef54203 req-169a2d4d-c103-4984-ad53-9b36de6458f7 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d7080289-00d8-4bcf-af18-f6741ef54203 req-169a2d4d-c103-4984-ad53-9b36de6458f7 service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d7080289-00d8-4bcf-af18-f6741ef54203 req-169a2d4d-c103-4984-ad53-9b36de6458f7 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d7080289-00d8-4bcf-af18-f6741ef54203 req-169a2d4d-c103-4984-ad53-9b36de6458f7 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-d7080289-00d8-4bcf-af18-f6741ef54203 req-169a2d4d-c103-4984-ad53-9b36de6458f7 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:47 user nova-compute[72178]: WARNING nova.compute.manager [req-d7080289-00d8-4bcf-af18-f6741ef54203 req-169a2d4d-c103-4984-ad53-9b36de6458f7 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state active and task_state rescuing.
Aug 01 12:03:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0.part --force-share --output=json" returned: 0 in 0.176s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG nova.virt.images [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] 09330b4a-05c2-4841-9a51-f6d8d5a0fcf1 was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:03:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0.part /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0.part /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0.converted" returned: 0 in 0.510s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "b019111ba1a850dd24c26ed34c604f2b6b09a4f0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.839s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "b019111ba1a850dd24c26ed34c604f2b6b09a4f0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "b019111ba1a850dd24c26ed34c604f2b6b09a4f0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0 --force-share --output=json" returned: 0 in 0.185s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0,backing_fmt=raw /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0,backing_fmt=raw /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue" returned: 0 in 0.068s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "b019111ba1a850dd24c26ed34c604f2b6b09a4f0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'migration_context' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Start _get_guest_xml network_info=[{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "vif_mac": "fa:16:3e:d8:e0:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '09330b4a-05c2-4841-9a51-f6d8d5a0fcf1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKHUevhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd3870f4a-ea47-4075-b342-2b20cfa749f9', 'attached_at': '', 'detached_at': '', 'volume_id': 'bed47c42-bdf4-47ca-8963-50ec3e68e25c', 'serial': 'bed47c42-bdf4-47ca-8963-50ec3e68e25c'}, 'boot_index': 0, 'attachment_id': 'cd0fb301-ddeb-4eee-93b3-024f6814749d', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'resources' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'numa_topology' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:03:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKHUevhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:03:48 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:48 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:03:48 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c42900-ad4e-4297-b611-af17ba4b70f4]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tKHUevhI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 12:03:48 user nova-compute[72178]: node.name = iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c
Aug 01 12:03:48 user nova-compute[72178]: node.tpgt = -1
Aug 01 12:03:48 user nova-compute[72178]: node.startup = automatic
Aug 01 12:03:48 user nova-compute[72178]: node.leading_login = No
Aug 01 12:03:48 user nova-compute[72178]: iface.iscsi_ifacename = default
Aug 01 12:03:48 user nova-compute[72178]: iface.net_ifacename = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.ipaddress = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.prefix_len = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.hwaddress = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.transport_name = tcp
Aug 01 12:03:48 user nova-compute[72178]: iface.initiatorname = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.state = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.vlan_id = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.vlan_priority = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.vlan_state = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.iface_num = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.mtu = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.port = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.bootproto = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.subnet_mask = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.gateway = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.dhcp_alt_client_id = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.dhcp_dns = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.dhcp_learn_iqn = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.dhcp_vendor_id_state = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.dhcp_vendor_id = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.dhcp_slp_da = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.fragmentation = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.gratuitous_arp = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.incoming_forwarding = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.tos_state = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.tos = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.ttl = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.delayed_ack = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.tcp_nagle = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.tcp_wsf_state = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.tcp_wsf = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.tcp_timer_scale = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.tcp_timestamp = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.redirect = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.def_task_mgmt_timeout = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.header_digest = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.data_digest = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.immediate_data = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.initial_r2t = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.data_seq_inorder = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.data_pdu_inorder = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.erl = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.max_receive_data_len = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.first_burst_len = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.max_outstanding_r2t = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.max_burst_len = 0
Aug 01 12:03:48 user nova-compute[72178]: iface.chap_auth = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.bidi_chap = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.strict_login_compliance = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.discovery_auth = <empty>
Aug 01 12:03:48 user nova-compute[72178]: iface.discovery_logout = <empty>
Aug 01 12:03:48 user nova-compute[72178]: node.discovery_address = <empty>
Aug 01 12:03:48 user nova-compute[72178]: node.discovery_port = 0
Aug 01 12:03:48 user nova-compute[72178]: node.discovery_type = static
Aug 01 12:03:48 user nova-compute[72178]: node.session.initial_cmdsn = 0
Aug 01 12:03:48 user nova-compute[72178]: node.session.initial_login_retry_max = 8
Aug 01 12:03:48 user nova-compute[72178]: node.session.xmit_thread_priority = -20
Aug 01 12:03:48 user nova-compute[72178]: node.session.cmds_max = 128
Aug 01 12:03:48 user nova-compute[72178]: node.session.queue_depth = 32
Aug 01 12:03:48 user nova-compute[72178]: node.session.nr_sessions = 1
Aug 01 12:03:48 user nova-compute[72178]: node.session.auth.authmethod = CHAP
Aug 01 12:03:48 user nova-compute[72178]: node.session.auth.username = tKHUevhI
Aug 01 12:03:48 user nova-compute[72178]: node.session.auth.password = ***
Aug 01 12:03:48 user nova-compute[72178]: node.session.auth.username_in = <empty>
Aug 01 12:03:48 user nova-compute[72178]: node.session.auth.password_in = <empty>
Aug 01 12:03:48 user nova-compute[72178]: node.session.auth.chap_algs = MD5
Aug 01 12:03:48 user nova-compute[72178]: node.session.timeo.replacement_timeout = 120
Aug 01 12:03:48 user nova-compute[72178]: node.session.err_timeo.abort_timeout = 15
Aug 01 12:03:48 user nova-compute[72178]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 12:03:48 user nova-compute[72178]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 12:03:48 user nova-compute[72178]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.FastAbort = Yes
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.InitialR2T = No
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.ImmediateData = Yes
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.MaxConnections = 1
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 12:03:48 user nova-compute[72178]: node.session.iscsi.ERL = 0
Aug 01 12:03:48 user nova-compute[72178]: node.session.scan = manual
Aug 01 12:03:48 user nova-compute[72178]: node.session.reopen_max = 0
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].address = 172.16.0.220
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].port = 3260
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].startup = manual
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].tcp.window_size = 524288
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].tcp.type_of_service = 0
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].timeo.logout_timeout = 15
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].timeo.login_timeout = 15
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].timeo.auth_timeout = 45
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].iscsi.DataDigest = None
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].iscsi.IFMarker = No
Aug 01 12:03:48 user nova-compute[72178]: node.conn[0].iscsi.OFMarker = No
Aug 01 12:03:48 user nova-compute[72178]: # END RECORD
Aug 01 12:03:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d46ac62-5356-40a1-a068-9a7b4fd27a21]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60ca425-6e7e-47e2-8bfe-9cba74e9d745]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKHUevhI {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tKHUevhI" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf037c-efd7-4c23-9e12-c8cea0ef35c0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tKHUevhI'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.090s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a50e60-6d6a-4bcb-97a9-8498755bf9a3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[905f837e-52c9-491e-97af-91d0ffa5bd61]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:48 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:48 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:48 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:48 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:03:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:03:48 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:03:48 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:03:48 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:03:48 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:03:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.231s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] HCTL ('33', '0', '0', 0) found on session 11 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:03:48 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8031881-a0aa-4ca1-88c3-287bee69769b]: (4, ('0 0 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching for a device in session 11 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKHUevhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.258s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] <== connect_volume: return (260ms) {'type': 'block', 'scsi_wwn': '23535353930383539', 'path': '/dev/sdb'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535353930383539', 'path': '/dev/sdb'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-280081968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-280081968',id=14,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:02:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-js1gllif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:02:14Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=d3870f4a-ea47-4075-b342-2b20cfa749f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "vif_mac": "fa:16:3e:d8:e0:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "vif_mac": "fa:16:3e:d8:e0:4a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=b7d6253a-cf03-47ad-8398-2a9c13e58116,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d6253a-cf') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'pci_devices' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:03:49 user nova-compute[72178]:   <uuid>d3870f4a-ea47-4075-b342-2b20cfa749f9</uuid>
Aug 01 12:03:49 user nova-compute[72178]:   <name>instance-0000000e</name>
Aug 01 12:03:49 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:03:49 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:03:49 user nova-compute[72178]:   <metadata>
Aug 01 12:03:49 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:03:49 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:03:49 user nova-compute[72178]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-280081968</nova:name>
Aug 01 12:03:49 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:03:48</nova:creationTime>
Aug 01 12:03:49 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:03:49 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:03:49 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:03:49 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:03:49 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:03:49 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:03:49 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:03:49 user nova-compute[72178]:       <nova:owner>
Aug 01 12:03:49 user nova-compute[72178]:         <nova:user uuid="ec0992e3a27a4a44922268a46b27ad83">tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member</nova:user>
Aug 01 12:03:49 user nova-compute[72178]:         <nova:project uuid="d5e2fc3212d24561b0b971241fe367ec">tempest-ServerBootFromVolumeStableRescueTest-2013636577</nova:project>
Aug 01 12:03:49 user nova-compute[72178]:       </nova:owner>
Aug 01 12:03:49 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:03:49 user nova-compute[72178]:       <nova:ports>
Aug 01 12:03:49 user nova-compute[72178]:         <nova:port uuid="b7d6253a-cf03-47ad-8398-2a9c13e58116">
Aug 01 12:03:49 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 12:03:49 user nova-compute[72178]:         </nova:port>
Aug 01 12:03:49 user nova-compute[72178]:       </nova:ports>
Aug 01 12:03:49 user nova-compute[72178]:     </nova:instance>
Aug 01 12:03:49 user nova-compute[72178]:   </metadata>
Aug 01 12:03:49 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:03:49 user nova-compute[72178]:     <system>
Aug 01 12:03:49 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:03:49 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:03:49 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:03:49 user nova-compute[72178]:       <entry name="serial">d3870f4a-ea47-4075-b342-2b20cfa749f9</entry>
Aug 01 12:03:49 user nova-compute[72178]:       <entry name="uuid">d3870f4a-ea47-4075-b342-2b20cfa749f9</entry>
Aug 01 12:03:49 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:03:49 user nova-compute[72178]:     </system>
Aug 01 12:03:49 user nova-compute[72178]:   </sysinfo>
Aug 01 12:03:49 user nova-compute[72178]:   <os>
Aug 01 12:03:49 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:03:49 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:03:49 user nova-compute[72178]:   </os>
Aug 01 12:03:49 user nova-compute[72178]:   <features>
Aug 01 12:03:49 user nova-compute[72178]:     <acpi/>
Aug 01 12:03:49 user nova-compute[72178]:     <apic/>
Aug 01 12:03:49 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:03:49 user nova-compute[72178]:   </features>
Aug 01 12:03:49 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:03:49 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:03:49 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:03:49 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:03:49 user nova-compute[72178]:   </clock>
Aug 01 12:03:49 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:03:49 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:03:49 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:03:49 user nova-compute[72178]:   </cpu>
Aug 01 12:03:49 user nova-compute[72178]:   <devices>
Aug 01 12:03:49 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:03:49 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:03:49 user nova-compute[72178]:       <source dev="/dev/sdb"/>
Aug 01 12:03:49 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:03:49 user nova-compute[72178]:       <serial>bed47c42-bdf4-47ca-8963-50ec3e68e25c</serial>
Aug 01 12:03:49 user nova-compute[72178]:     </disk>
Aug 01 12:03:49 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:03:49 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:03:49 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue"/>
Aug 01 12:03:49 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:03:49 user nova-compute[72178]:       <boot order="1"/>
Aug 01 12:03:49 user nova-compute[72178]:     </disk>
Aug 01 12:03:49 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:03:49 user nova-compute[72178]:       <mac address="fa:16:3e:d8:e0:4a"/>
Aug 01 12:03:49 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:49 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:03:49 user nova-compute[72178]:       <target dev="tapb7d6253a-cf"/>
Aug 01 12:03:49 user nova-compute[72178]:     </interface>
Aug 01 12:03:49 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:03:49 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/console.log" append="off"/>
Aug 01 12:03:49 user nova-compute[72178]:     </serial>
Aug 01 12:03:49 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:03:49 user nova-compute[72178]:     <video>
Aug 01 12:03:49 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:03:49 user nova-compute[72178]:     </video>
Aug 01 12:03:49 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:03:49 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:03:49 user nova-compute[72178]:     </rng>
Aug 01 12:03:49 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:03:49 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:03:49 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:03:49 user nova-compute[72178]:     </memballoon>
Aug 01 12:03:49 user nova-compute[72178]:   </devices>
Aug 01 12:03:49 user nova-compute[72178]: </domain>
Aug 01 12:03:49 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:03:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance destroyed successfully.
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:03:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No VIF found with MAC fa:16:3e:d8:e0:4a, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-dd2c0489-7e31-47ad-8c3c-98d7bd0b58c2 req-df0bf65b-5534-4bf7-9df2-f141e8cb176e service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dd2c0489-7e31-47ad-8c3c-98d7bd0b58c2 req-df0bf65b-5534-4bf7-9df2-f141e8cb176e service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dd2c0489-7e31-47ad-8c3c-98d7bd0b58c2 req-df0bf65b-5534-4bf7-9df2-f141e8cb176e service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dd2c0489-7e31-47ad-8c3c-98d7bd0b58c2 req-df0bf65b-5534-4bf7-9df2-f141e8cb176e service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-dd2c0489-7e31-47ad-8c3c-98d7bd0b58c2 req-df0bf65b-5534-4bf7-9df2-f141e8cb176e service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:50 user nova-compute[72178]: WARNING nova.compute.manager [req-dd2c0489-7e31-47ad-8c3c-98d7bd0b58c2 req-df0bf65b-5534-4bf7-9df2-f141e8cb176e service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state active and task_state rescuing.
Aug 01 12:03:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-e82c100e-96db-4b3f-a893-4bc0f8831322 req-3605f093-6811-48d1-8fae-788a21e8f601 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:03:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e82c100e-96db-4b3f-a893-4bc0f8831322 req-3605f093-6811-48d1-8fae-788a21e8f601 service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:03:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e82c100e-96db-4b3f-a893-4bc0f8831322 req-3605f093-6811-48d1-8fae-788a21e8f601 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:03:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e82c100e-96db-4b3f-a893-4bc0f8831322 req-3605f093-6811-48d1-8fae-788a21e8f601 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:03:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-e82c100e-96db-4b3f-a893-4bc0f8831322 req-3605f093-6811-48d1-8fae-788a21e8f601 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:03:52 user nova-compute[72178]: WARNING nova.compute.manager [req-e82c100e-96db-4b3f-a893-4bc0f8831322 req-3605f093-6811-48d1-8fae-788a21e8f601 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state active and task_state rescuing.
Aug 01 12:03:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for d3870f4a-ea47-4075-b342-2b20cfa749f9 due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:03:53 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891433.095697, d3870f4a-ea47-4075-b342-2b20cfa749f9 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:53 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] VM Resumed (Lifecycle Event)
Aug 01 12:03:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d0577cef-52a8-4eb4-a8c3-534fe7f0fdcf tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:53 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 12:03:53 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891433.0994234, d3870f4a-ea47-4075-b342-2b20cfa749f9 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:03:53 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] VM Started (Lifecycle Event)
Aug 01 12:03:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:03:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:03:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:03:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:04:05 user nova-compute[72178]: INFO nova.compute.claims [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Claim successful on node user
Aug 01 12:04:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:04:05 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:04:05 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Creating image(s)
Aug 01 12:04:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "/opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "/opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG nova.policy [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2d25ebda28942faad0e95c91d565732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff9be9ff999d442a90932dedb57de9df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk 1073741824" returned: 0 in 0.059s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.193s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Cannot resize image /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lazy-loading 'migration_context' on Instance uuid 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Ensure instance console log exists: /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:07 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Successfully created port: 128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:04:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Successfully updated port: 128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "refresh_cache-1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquired lock "refresh_cache-1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec977dea-5d99-4b47-890b-cf7d511f299b req-00cc5d32-0c40-4453-8493-093b0f89f520 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received event network-changed-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec977dea-5d99-4b47-890b-cf7d511f299b req-00cc5d32-0c40-4453-8493-093b0f89f520 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Refreshing instance network info cache due to event network-changed-128a1401-bebc-4ef9-9365-14076992ab8a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec977dea-5d99-4b47-890b-cf7d511f299b req-00cc5d32-0c40-4453-8493-093b0f89f520 service nova] Acquiring lock "refresh_cache-1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Updating instance_info_cache with network_info: [{"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Releasing lock "refresh_cache-1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Instance network_info: |[{"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec977dea-5d99-4b47-890b-cf7d511f299b req-00cc5d32-0c40-4453-8493-093b0f89f520 service nova] Acquired lock "refresh_cache-1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec977dea-5d99-4b47-890b-cf7d511f299b req-00cc5d32-0c40-4453-8493-093b0f89f520 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Refreshing network info cache for port 128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Start _get_guest_xml network_info=[{"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:04:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:04:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-619255797',display_name='tempest-VolumesNegativeTest-instance-619255797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-619255797',id=17,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff9be9ff999d442a90932dedb57de9df',ramdisk_id='',reservation_id='r-p839t0i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1457193251',owner_user_name='tempest-VolumesNegativeTest-1457193251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:04:06Z,user_data=None,user_id='d2d25ebda28942faad0e95c91d565732',uuid=1c29d606-c2ab-46ab-8f35-8f9a0de5fb57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Converting VIF {"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a5:ff,bridge_name='br-int',has_traffic_filtering=True,id=128a1401-bebc-4ef9-9365-14076992ab8a,network=Network(e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128a1401-be') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:04:08 user nova-compute[72178]:   <uuid>1c29d606-c2ab-46ab-8f35-8f9a0de5fb57</uuid>
Aug 01 12:04:08 user nova-compute[72178]:   <name>instance-00000011</name>
Aug 01 12:04:08 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:04:08 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:04:08 user nova-compute[72178]:   <metadata>
Aug 01 12:04:08 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:04:08 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:04:08 user nova-compute[72178]:       <nova:name>tempest-VolumesNegativeTest-instance-619255797</nova:name>
Aug 01 12:04:08 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:04:08</nova:creationTime>
Aug 01 12:04:08 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:04:08 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:04:08 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:04:08 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:04:08 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:04:08 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:04:08 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:04:08 user nova-compute[72178]:       <nova:owner>
Aug 01 12:04:08 user nova-compute[72178]:         <nova:user uuid="d2d25ebda28942faad0e95c91d565732">tempest-VolumesNegativeTest-1457193251-project-member</nova:user>
Aug 01 12:04:08 user nova-compute[72178]:         <nova:project uuid="ff9be9ff999d442a90932dedb57de9df">tempest-VolumesNegativeTest-1457193251</nova:project>
Aug 01 12:04:08 user nova-compute[72178]:       </nova:owner>
Aug 01 12:04:08 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:04:08 user nova-compute[72178]:       <nova:ports>
Aug 01 12:04:08 user nova-compute[72178]:         <nova:port uuid="128a1401-bebc-4ef9-9365-14076992ab8a">
Aug 01 12:04:08 user nova-compute[72178]:           <nova:ip type="fixed" address="192.168.233.220" ipVersion="4"/>
Aug 01 12:04:08 user nova-compute[72178]:         </nova:port>
Aug 01 12:04:08 user nova-compute[72178]:       </nova:ports>
Aug 01 12:04:08 user nova-compute[72178]:     </nova:instance>
Aug 01 12:04:08 user nova-compute[72178]:   </metadata>
Aug 01 12:04:08 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:04:08 user nova-compute[72178]:     <system>
Aug 01 12:04:08 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:04:08 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:04:08 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:04:08 user nova-compute[72178]:       <entry name="serial">1c29d606-c2ab-46ab-8f35-8f9a0de5fb57</entry>
Aug 01 12:04:08 user nova-compute[72178]:       <entry name="uuid">1c29d606-c2ab-46ab-8f35-8f9a0de5fb57</entry>
Aug 01 12:04:08 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:04:08 user nova-compute[72178]:     </system>
Aug 01 12:04:08 user nova-compute[72178]:   </sysinfo>
Aug 01 12:04:08 user nova-compute[72178]:   <os>
Aug 01 12:04:08 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:04:08 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:04:08 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:04:08 user nova-compute[72178]:   </os>
Aug 01 12:04:08 user nova-compute[72178]:   <features>
Aug 01 12:04:08 user nova-compute[72178]:     <acpi/>
Aug 01 12:04:08 user nova-compute[72178]:     <apic/>
Aug 01 12:04:08 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:04:08 user nova-compute[72178]:   </features>
Aug 01 12:04:08 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:04:08 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:04:08 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:04:08 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:04:08 user nova-compute[72178]:   </clock>
Aug 01 12:04:08 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:04:08 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:04:08 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:04:08 user nova-compute[72178]:   </cpu>
Aug 01 12:04:08 user nova-compute[72178]:   <devices>
Aug 01 12:04:08 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:04:08 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:04:08 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk"/>
Aug 01 12:04:08 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:04:08 user nova-compute[72178]:     </disk>
Aug 01 12:04:08 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:04:08 user nova-compute[72178]:       <mac address="fa:16:3e:2e:a5:ff"/>
Aug 01 12:04:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:04:08 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:04:08 user nova-compute[72178]:       <target dev="tap128a1401-be"/>
Aug 01 12:04:08 user nova-compute[72178]:     </interface>
Aug 01 12:04:08 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:04:08 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/console.log" append="off"/>
Aug 01 12:04:08 user nova-compute[72178]:     </serial>
Aug 01 12:04:08 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:04:08 user nova-compute[72178]:     <video>
Aug 01 12:04:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:04:08 user nova-compute[72178]:     </video>
Aug 01 12:04:08 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:04:08 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:04:08 user nova-compute[72178]:     </rng>
Aug 01 12:04:08 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:04:08 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:04:08 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:04:08 user nova-compute[72178]:     </memballoon>
Aug 01 12:04:08 user nova-compute[72178]:   </devices>
Aug 01 12:04:08 user nova-compute[72178]: </domain>
Aug 01 12:04:08 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-619255797',display_name='tempest-VolumesNegativeTest-instance-619255797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-619255797',id=17,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff9be9ff999d442a90932dedb57de9df',ramdisk_id='',reservation_id='r-p839t0i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1457193251',owner_user_name='tempest-VolumesNegativeTest-1457193251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:04:06Z,user_data=None,user_id='d2d25ebda28942faad0e95c91d565732',uuid=1c29d606-c2ab-46ab-8f35-8f9a0de5fb57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Converting VIF {"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a5:ff,bridge_name='br-int',has_traffic_filtering=True,id=128a1401-bebc-4ef9-9365-14076992ab8a,network=Network(e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128a1401-be') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG os_vif [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a5:ff,bridge_name='br-int',has_traffic_filtering=True,id=128a1401-bebc-4ef9-9365-14076992ab8a,network=Network(e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128a1401-be') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap128a1401-be, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap128a1401-be, col_values=(('external_ids', {'iface-id': '128a1401-bebc-4ef9-9365-14076992ab8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:a5:ff', 'vm-uuid': '1c29d606-c2ab-46ab-8f35-8f9a0de5fb57'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:08 user nova-compute[72178]: INFO os_vif [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a5:ff,bridge_name='br-int',has_traffic_filtering=True,id=128a1401-bebc-4ef9-9365-14076992ab8a,network=Network(e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128a1401-be')
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:04:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] No VIF found with MAC fa:16:3e:2e:a5:ff, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:04:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec977dea-5d99-4b47-890b-cf7d511f299b req-00cc5d32-0c40-4453-8493-093b0f89f520 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Updated VIF entry in instance network info cache for port 128a1401-bebc-4ef9-9365-14076992ab8a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:04:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec977dea-5d99-4b47-890b-cf7d511f299b req-00cc5d32-0c40-4453-8493-093b0f89f520 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Updating instance_info_cache with network_info: [{"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec977dea-5d99-4b47-890b-cf7d511f299b req-00cc5d32-0c40-4453-8493-093b0f89f520 service nova] Releasing lock "refresh_cache-1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG nova.compute.manager [req-a5f3756d-b38d-4d36-ae4b-5952a0096d9c req-ca7714ff-f0cc-4fce-b172-a6a436494d0e service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received event network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a5f3756d-b38d-4d36-ae4b-5952a0096d9c req-ca7714ff-f0cc-4fce-b172-a6a436494d0e service nova] Acquiring lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a5f3756d-b38d-4d36-ae4b-5952a0096d9c req-ca7714ff-f0cc-4fce-b172-a6a436494d0e service nova] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a5f3756d-b38d-4d36-ae4b-5952a0096d9c req-ca7714ff-f0cc-4fce-b172-a6a436494d0e service nova] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG nova.compute.manager [req-a5f3756d-b38d-4d36-ae4b-5952a0096d9c req-ca7714ff-f0cc-4fce-b172-a6a436494d0e service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] No waiting events found dispatching network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:10 user nova-compute[72178]: WARNING nova.compute.manager [req-a5f3756d-b38d-4d36-ae4b-5952a0096d9c req-ca7714ff-f0cc-4fce-b172-a6a436494d0e service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received unexpected event network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a for instance with vm_state building and task_state spawning.
Aug 01 12:04:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891452.4244165, 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:04:12 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] VM Resumed (Lifecycle Event)
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:04:12 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Instance spawned successfully.
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:12 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891452.4258087, 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:04:12 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] VM Started (Lifecycle Event)
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:04:12 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:04:12 user nova-compute[72178]: INFO nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:12 user nova-compute[72178]: INFO nova.compute.manager [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Took 7.72 seconds to build instance.
Aug 01 12:04:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0fb7acb0-e6d6-41f6-be15-7b0afaf19808 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.852s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-8839f14e-82a6-49f3-bf8a-d0d0b9425063 req-63e68d00-e386-4fdd-9333-c928e1d464a9 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received event network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8839f14e-82a6-49f3-bf8a-d0d0b9425063 req-63e68d00-e386-4fdd-9333-c928e1d464a9 service nova] Acquiring lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8839f14e-82a6-49f3-bf8a-d0d0b9425063 req-63e68d00-e386-4fdd-9333-c928e1d464a9 service nova] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8839f14e-82a6-49f3-bf8a-d0d0b9425063 req-63e68d00-e386-4fdd-9333-c928e1d464a9 service nova] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-8839f14e-82a6-49f3-bf8a-d0d0b9425063 req-63e68d00-e386-4fdd-9333-c928e1d464a9 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] No waiting events found dispatching network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:12 user nova-compute[72178]: WARNING nova.compute.manager [req-8839f14e-82a6-49f3-bf8a-d0d0b9425063 req-63e68d00-e386-4fdd-9333-c928e1d464a9 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received unexpected event network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a for instance with vm_state active and task_state None.
Aug 01 12:04:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "f4ae1965-8660-4deb-8427-cafa57f837c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:04:13 user nova-compute[72178]: INFO nova.compute.claims [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Claim successful on node user
Aug 01 12:04:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.736s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:04:13 user nova-compute[72178]: DEBUG nova.network.neutron [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:04:13 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.policy [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '551db946d0e94b50af2c5c659f4c82ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee13aa6423e4d33bfe59e2a092a5578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:04:14 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Creating image(s)
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "/opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "/opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "a742f6ab-310e-4652-968d-7840febae699" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "a742f6ab-310e-4652-968d-7840febae699" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "a742f6ab-310e-4652-968d-7840febae699-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "a742f6ab-310e-4652-968d-7840febae699-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "a742f6ab-310e-4652-968d-7840febae699-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:14 user nova-compute[72178]: INFO nova.compute.manager [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Terminating instance
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.198s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.249s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk 1073741824" returned: 0 in 0.086s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-06684efc-2052-4081-a8e5-c15198fd36a8 req-745e87fe-81c2-4a12-b530-b6c9f8fbc08e service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received event network-vif-unplugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-06684efc-2052-4081-a8e5-c15198fd36a8 req-745e87fe-81c2-4a12-b530-b6c9f8fbc08e service nova] Acquiring lock "a742f6ab-310e-4652-968d-7840febae699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-06684efc-2052-4081-a8e5-c15198fd36a8 req-745e87fe-81c2-4a12-b530-b6c9f8fbc08e service nova] Lock "a742f6ab-310e-4652-968d-7840febae699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-06684efc-2052-4081-a8e5-c15198fd36a8 req-745e87fe-81c2-4a12-b530-b6c9f8fbc08e service nova] Lock "a742f6ab-310e-4652-968d-7840febae699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-06684efc-2052-4081-a8e5-c15198fd36a8 req-745e87fe-81c2-4a12-b530-b6c9f8fbc08e service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] No waiting events found dispatching network-vif-unplugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-06684efc-2052-4081-a8e5-c15198fd36a8 req-745e87fe-81c2-4a12-b530-b6c9f8fbc08e service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received event network-vif-unplugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.188s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:04:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-9ce20913-e153-4889-88d1-ed6f37a3b858 req-2108a57b-ddd3-475c-b3a7-9ea68aac5315 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-changed-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-9ce20913-e153-4889-88d1-ed6f37a3b858 req-2108a57b-ddd3-475c-b3a7-9ea68aac5315 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Refreshing instance network info cache due to event network-changed-1c228670-844c-44a4-ad61-a9982fe910fd. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9ce20913-e153-4889-88d1-ed6f37a3b858 req-2108a57b-ddd3-475c-b3a7-9ea68aac5315 service nova] Acquiring lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9ce20913-e153-4889-88d1-ed6f37a3b858 req-2108a57b-ddd3-475c-b3a7-9ea68aac5315 service nova] Acquired lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.network.neutron [req-9ce20913-e153-4889-88d1-ed6f37a3b858 req-2108a57b-ddd3-475c-b3a7-9ea68aac5315 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Refreshing network info cache for port 1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Cannot resize image /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.objects.instance [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'migration_context' on Instance uuid f4ae1965-8660-4deb-8427-cafa57f837c8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Ensure instance console log exists: /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:15 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a742f6ab-310e-4652-968d-7840febae699] Instance destroyed successfully.
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.objects.instance [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'resources' on Instance uuid a742f6ab-310e-4652-968d-7840febae699 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-494976912',display_name='tempest-VolumesAdminNegativeTest-server-494976912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-494976912',id=15,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:02:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='966cb02845ea40aea6b64cabe1f600c2',ramdisk_id='',reservation_id='r-lzjtr0k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1802258801',owner_user_name='tempest-VolumesAdminNegativeTest-1802258801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:02:23Z,user_data=None,user_id='fc6bcb5e39f04635abbc68fcddfcf8d1',uuid=a742f6ab-310e-4652-968d-7840febae699,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converting VIF {"id": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "address": "fa:16:3e:4c:5e:8c", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9d5c59c-8a", "ovs_interfaceid": "e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:5e:8c,bridge_name='br-int',has_traffic_filtering=True,id=e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5c59c-8a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG os_vif [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:5e:8c,bridge_name='br-int',has_traffic_filtering=True,id=e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5c59c-8a') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9d5c59c-8a, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:04:15 user nova-compute[72178]: INFO os_vif [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:5e:8c,bridge_name='br-int',has_traffic_filtering=True,id=e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9d5c59c-8a')
Aug 01 12:04:15 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Deleting instance files /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699_del
Aug 01 12:04:15 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Deletion of /opt/stack/data/nova/instances/a742f6ab-310e-4652-968d-7840febae699_del complete
Aug 01 12:04:15 user nova-compute[72178]: INFO nova.compute.manager [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: a742f6ab-310e-4652-968d-7840febae699] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: a742f6ab-310e-4652-968d-7840febae699] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: a742f6ab-310e-4652-968d-7840febae699] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "interface-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "interface-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'flavor' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:15 user nova-compute[72178]: DEBUG nova.network.neutron [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Successfully created port: ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'pci_requests' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Successfully updated port: ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquired lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-f60d1df0-cfc7-4ebe-9dde-a2019f3f530a req-9380a6fe-b85f-4ee1-b21a-0a12d312e819 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received event network-changed-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-f60d1df0-cfc7-4ebe-9dde-a2019f3f530a req-9380a6fe-b85f-4ee1-b21a-0a12d312e819 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Refreshing instance network info cache due to event network-changed-ce1a144e-d9df-4bb3-846d-7e0ebffd4373. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f60d1df0-cfc7-4ebe-9dde-a2019f3f530a req-9380a6fe-b85f-4ee1-b21a-0a12d312e819 service nova] Acquiring lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.network.neutron [req-9ce20913-e153-4889-88d1-ed6f37a3b858 req-2108a57b-ddd3-475c-b3a7-9ea68aac5315 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updated VIF entry in instance network info cache for port 1c228670-844c-44a4-ad61-a9982fe910fd. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.network.neutron [req-9ce20913-e153-4889-88d1-ed6f37a3b858 req-2108a57b-ddd3-475c-b3a7-9ea68aac5315 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating instance_info_cache with network_info: [{"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.policy [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7a73caf203ad4e8aaac7a1efb956c048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22155938fca465f904a75e3d0a1bd56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9ce20913-e153-4889-88d1-ed6f37a3b858 req-2108a57b-ddd3-475c-b3a7-9ea68aac5315 service nova] Releasing lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-1878993d-f4e7-46c5-b4cb-ecce979530cd req-c354395c-eff4-4128-95e5-44515f690cd5 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received event network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1878993d-f4e7-46c5-b4cb-ecce979530cd req-c354395c-eff4-4128-95e5-44515f690cd5 service nova] Acquiring lock "a742f6ab-310e-4652-968d-7840febae699-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1878993d-f4e7-46c5-b4cb-ecce979530cd req-c354395c-eff4-4128-95e5-44515f690cd5 service nova] Lock "a742f6ab-310e-4652-968d-7840febae699-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1878993d-f4e7-46c5-b4cb-ecce979530cd req-c354395c-eff4-4128-95e5-44515f690cd5 service nova] Lock "a742f6ab-310e-4652-968d-7840febae699-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-1878993d-f4e7-46c5-b4cb-ecce979530cd req-c354395c-eff4-4128-95e5-44515f690cd5 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] No waiting events found dispatching network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:16 user nova-compute[72178]: WARNING nova.compute.manager [req-1878993d-f4e7-46c5-b4cb-ecce979530cd req-c354395c-eff4-4128-95e5-44515f690cd5 service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received unexpected event network-vif-plugged-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc for instance with vm_state active and task_state deleting.
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Updating instance_info_cache with network_info: [{"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Releasing lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Instance network_info: |[{"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f60d1df0-cfc7-4ebe-9dde-a2019f3f530a req-9380a6fe-b85f-4ee1-b21a-0a12d312e819 service nova] Acquired lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-f60d1df0-cfc7-4ebe-9dde-a2019f3f530a req-9380a6fe-b85f-4ee1-b21a-0a12d312e819 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Refreshing network info cache for port ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Start _get_guest_xml network_info=[{"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:04:17 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:04:17 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1406287704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1406287704',id=18,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwKpu63TDZ2dE90KUlxR6gihMelJM8kyz6h2HQUyVAVSvHZvdFZHoiDJUpUEHmUelPFwD4bL3nr9jBqwV5AZ97OV8UBY7k3Pb0wb46vrcxs9nDXNVTW0EOXuHMZbuATew==',key_name='tempest-keypair-181046735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-w0o1rt6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=f4ae1965-8660-4deb-8427-cafa57f837c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=ce1a144e-d9df-4bb3-846d-7e0ebffd4373,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a144e-d9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'pci_devices' on Instance uuid f4ae1965-8660-4deb-8427-cafa57f837c8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:04:17 user nova-compute[72178]:   <uuid>f4ae1965-8660-4deb-8427-cafa57f837c8</uuid>
Aug 01 12:04:17 user nova-compute[72178]:   <name>instance-00000012</name>
Aug 01 12:04:17 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:04:17 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:04:17 user nova-compute[72178]:   <metadata>
Aug 01 12:04:17 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:04:17 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:04:17 user nova-compute[72178]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1406287704</nova:name>
Aug 01 12:04:17 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:04:17</nova:creationTime>
Aug 01 12:04:17 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:04:17 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:04:17 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:04:17 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:04:17 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:04:17 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:04:17 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:04:17 user nova-compute[72178]:       <nova:owner>
Aug 01 12:04:17 user nova-compute[72178]:         <nova:user uuid="551db946d0e94b50af2c5c659f4c82ce">tempest-ServerActionsV293TestJSON-1322074-project-member</nova:user>
Aug 01 12:04:17 user nova-compute[72178]:         <nova:project uuid="7ee13aa6423e4d33bfe59e2a092a5578">tempest-ServerActionsV293TestJSON-1322074</nova:project>
Aug 01 12:04:17 user nova-compute[72178]:       </nova:owner>
Aug 01 12:04:17 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:04:17 user nova-compute[72178]:       <nova:ports>
Aug 01 12:04:17 user nova-compute[72178]:         <nova:port uuid="ce1a144e-d9df-4bb3-846d-7e0ebffd4373">
Aug 01 12:04:17 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 12:04:17 user nova-compute[72178]:         </nova:port>
Aug 01 12:04:17 user nova-compute[72178]:       </nova:ports>
Aug 01 12:04:17 user nova-compute[72178]:     </nova:instance>
Aug 01 12:04:17 user nova-compute[72178]:   </metadata>
Aug 01 12:04:17 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:04:17 user nova-compute[72178]:     <system>
Aug 01 12:04:17 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:04:17 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:04:17 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:04:17 user nova-compute[72178]:       <entry name="serial">f4ae1965-8660-4deb-8427-cafa57f837c8</entry>
Aug 01 12:04:17 user nova-compute[72178]:       <entry name="uuid">f4ae1965-8660-4deb-8427-cafa57f837c8</entry>
Aug 01 12:04:17 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:04:17 user nova-compute[72178]:     </system>
Aug 01 12:04:17 user nova-compute[72178]:   </sysinfo>
Aug 01 12:04:17 user nova-compute[72178]:   <os>
Aug 01 12:04:17 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:04:17 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:04:17 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:04:17 user nova-compute[72178]:   </os>
Aug 01 12:04:17 user nova-compute[72178]:   <features>
Aug 01 12:04:17 user nova-compute[72178]:     <acpi/>
Aug 01 12:04:17 user nova-compute[72178]:     <apic/>
Aug 01 12:04:17 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:04:17 user nova-compute[72178]:   </features>
Aug 01 12:04:17 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:04:17 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:04:17 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:04:17 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:04:17 user nova-compute[72178]:   </clock>
Aug 01 12:04:17 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:04:17 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:04:17 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:04:17 user nova-compute[72178]:   </cpu>
Aug 01 12:04:17 user nova-compute[72178]:   <devices>
Aug 01 12:04:17 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:04:17 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:04:17 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk"/>
Aug 01 12:04:17 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:04:17 user nova-compute[72178]:     </disk>
Aug 01 12:04:17 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:04:17 user nova-compute[72178]:       <mac address="fa:16:3e:15:fc:55"/>
Aug 01 12:04:17 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:04:17 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:04:17 user nova-compute[72178]:       <target dev="tapce1a144e-d9"/>
Aug 01 12:04:17 user nova-compute[72178]:     </interface>
Aug 01 12:04:17 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:04:17 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/console.log" append="off"/>
Aug 01 12:04:17 user nova-compute[72178]:     </serial>
Aug 01 12:04:17 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:04:17 user nova-compute[72178]:     <video>
Aug 01 12:04:17 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:04:17 user nova-compute[72178]:     </video>
Aug 01 12:04:17 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:04:17 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:04:17 user nova-compute[72178]:     </rng>
Aug 01 12:04:17 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:04:17 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:04:17 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:04:17 user nova-compute[72178]:     </memballoon>
Aug 01 12:04:17 user nova-compute[72178]:   </devices>
Aug 01 12:04:17 user nova-compute[72178]: </domain>
Aug 01 12:04:17 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1406287704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1406287704',id=18,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwKpu63TDZ2dE90KUlxR6gihMelJM8kyz6h2HQUyVAVSvHZvdFZHoiDJUpUEHmUelPFwD4bL3nr9jBqwV5AZ97OV8UBY7k3Pb0wb46vrcxs9nDXNVTW0EOXuHMZbuATew==',key_name='tempest-keypair-181046735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-w0o1rt6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:04:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=f4ae1965-8660-4deb-8427-cafa57f837c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=ce1a144e-d9df-4bb3-846d-7e0ebffd4373,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a144e-d9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG os_vif [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=ce1a144e-d9df-4bb3-846d-7e0ebffd4373,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a144e-d9') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce1a144e-d9, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapce1a144e-d9, col_values=(('external_ids', {'iface-id': 'ce1a144e-d9df-4bb3-846d-7e0ebffd4373', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:fc:55', 'vm-uuid': 'f4ae1965-8660-4deb-8427-cafa57f837c8'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: a742f6ab-310e-4652-968d-7840febae699] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:17 user nova-compute[72178]: INFO os_vif [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=ce1a144e-d9df-4bb3-846d-7e0ebffd4373,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a144e-d9')
Aug 01 12:04:17 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: a742f6ab-310e-4652-968d-7840febae699] Took 1.73 seconds to deallocate network for instance.
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] No VIF found with MAC fa:16:3e:15:fc:55, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Successfully created port: 9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-f60d1df0-cfc7-4ebe-9dde-a2019f3f530a req-9380a6fe-b85f-4ee1-b21a-0a12d312e819 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Updated VIF entry in instance network info cache for port ce1a144e-d9df-4bb3-846d-7e0ebffd4373. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-f60d1df0-cfc7-4ebe-9dde-a2019f3f530a req-9380a6fe-b85f-4ee1-b21a-0a12d312e819 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Updating instance_info_cache with network_info: [{"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f60d1df0-cfc7-4ebe-9dde-a2019f3f530a req-9380a6fe-b85f-4ee1-b21a-0a12d312e819 service nova] Releasing lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:04:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.656s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:18 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Deleted allocations for instance a742f6ab-310e-4652-968d-7840febae699
Aug 01 12:04:18 user nova-compute[72178]: INFO nova.compute.manager [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Terminating instance
Aug 01 12:04:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-084db431-fc4c-458d-8207-d89d751e0878 tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "a742f6ab-310e-4652-968d-7840febae699" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.768s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Successfully updated port: 9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquired lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: a742f6ab-310e-4652-968d-7840febae699] Received event network-vif-deleted-e9d5c59c-8a19-405b-9b7a-1b999fa7c3bc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received event network-vif-unplugged-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] No waiting events found dispatching network-vif-unplugged-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received event network-vif-unplugged-3a03414e-614f-4b71-9eb7-36948736113c for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-changed-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Refreshing instance network info cache due to event network-changed-9e38494f-003a-4996-876e-69ae98f48743. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Acquiring lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Instance destroyed successfully.
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.objects.instance [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lazy-loading 'resources' on Instance uuid 98d39c47-5233-40b1-8d34-af244719fe52 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1930793926',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1930793926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1930793',id=13,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKD9XCmKULETf+Sv0lPVOMr8nOSEaM9/lzAmsSF1AiJPJrZAofvryL+aibbfAYaFU2czs+8XjrfFLihPSFaAow9AeuQUxxYYkBpyR3jiiHkQcIjZxplF336PXT6XQdfgQ==',key_name='tempest-keypair-491882663',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:01:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3c2820314944cba89d45b0d3cd80681',ramdisk_id='',reservation_id='r-dpy7m9uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2094198439',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:01:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aea8d3cf69c74eddad04ef8f6010c485',uuid=98d39c47-5233-40b1-8d34-af244719fe52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Converting VIF {"id": "3a03414e-614f-4b71-9eb7-36948736113c", "address": "fa:16:3e:b9:49:3a", "network": {"id": "a79bc6c4-72b8-4607-957a-ab1dcb49b05a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-117585309-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3c2820314944cba89d45b0d3cd80681", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03414e-61", "ovs_interfaceid": "3a03414e-614f-4b71-9eb7-36948736113c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:49:3a,bridge_name='br-int',has_traffic_filtering=True,id=3a03414e-614f-4b71-9eb7-36948736113c,network=Network(a79bc6c4-72b8-4607-957a-ab1dcb49b05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03414e-61') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG os_vif [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:49:3a,bridge_name='br-int',has_traffic_filtering=True,id=3a03414e-614f-4b71-9eb7-36948736113c,network=Network(a79bc6c4-72b8-4607-957a-ab1dcb49b05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03414e-61') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a03414e-61, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:19 user nova-compute[72178]: INFO os_vif [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:49:3a,bridge_name='br-int',has_traffic_filtering=True,id=3a03414e-614f-4b71-9eb7-36948736113c,network=Network(a79bc6c4-72b8-4607-957a-ab1dcb49b05a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03414e-61')
Aug 01 12:04:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Deleting instance files /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52_del
Aug 01 12:04:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Deletion of /opt/stack/data/nova/instances/98d39c47-5233-40b1-8d34-af244719fe52_del complete
Aug 01 12:04:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:19 user nova-compute[72178]: INFO nova.compute.manager [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Took 1.57 seconds to destroy the instance on the hypervisor.
Aug 01 12:04:19 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:04:19 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating instance_info_cache with network_info: [{"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Releasing lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Acquired lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.network.neutron [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Refreshing network info cache for port 9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1539614270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1539614270',id=16,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3l0CrAp4blgm8p6J/CpMMmsynu7w4Q6ggCy2BAEuQiOvazPWA7Q9HgfC4YOhoX00X2/4A1muPlL6MCNEVU526AcZQkLN/mo9CJfWbPp2gR5FdDgha9mZBUuswKBX7xCA==',key_name='tempest-keypair-591392986',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a22155938fca465f904a75e3d0a1bd56',ramdisk_id='',reservation_id='r-yze31y42',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431933072',owner_user_name='tempest-TaggedAttachmentsTest-1431933072-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a73caf203ad4e8aaac7a1efb956c048',uuid=a42c3ebd-74a5-4745-a2a8-ade6b5636dc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converting VIF {"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:da:a8,bridge_name='br-int',has_traffic_filtering=True,id=9e38494f-003a-4996-876e-69ae98f48743,network=Network(cc2caa8b-611b-4796-a999-adfde4a6665b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38494f-00') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG os_vif [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:da:a8,bridge_name='br-int',has_traffic_filtering=True,id=9e38494f-003a-4996-876e-69ae98f48743,network=Network(cc2caa8b-611b-4796-a999-adfde4a6665b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38494f-00') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e38494f-00, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e38494f-00, col_values=(('external_ids', {'iface-id': '9e38494f-003a-4996-876e-69ae98f48743', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:da:a8', 'vm-uuid': 'a42c3ebd-74a5-4745-a2a8-ade6b5636dc4'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:20 user nova-compute[72178]: INFO os_vif [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:da:a8,bridge_name='br-int',has_traffic_filtering=True,id=9e38494f-003a-4996-876e-69ae98f48743,network=Network(cc2caa8b-611b-4796-a999-adfde4a6665b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38494f-00')
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1539614270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1539614270',id=16,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3l0CrAp4blgm8p6J/CpMMmsynu7w4Q6ggCy2BAEuQiOvazPWA7Q9HgfC4YOhoX00X2/4A1muPlL6MCNEVU526AcZQkLN/mo9CJfWbPp2gR5FdDgha9mZBUuswKBX7xCA==',key_name='tempest-keypair-591392986',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a22155938fca465f904a75e3d0a1bd56',ramdisk_id='',reservation_id='r-yze31y42',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431933072',owner_user_name='tempest-TaggedAttachmentsTest-1431933072-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a73caf203ad4e8aaac7a1efb956c048',uuid=a42c3ebd-74a5-4745-a2a8-ade6b5636dc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converting VIF {"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:da:a8,bridge_name='br-int',has_traffic_filtering=True,id=9e38494f-003a-4996-876e-69ae98f48743,network=Network(cc2caa8b-611b-4796-a999-adfde4a6665b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38494f-00') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] attach device xml: <interface type="ethernet">
Aug 01 12:04:20 user nova-compute[72178]:   <mac address="fa:16:3e:71:da:a8"/>
Aug 01 12:04:20 user nova-compute[72178]:   <model type="virtio"/>
Aug 01 12:04:20 user nova-compute[72178]:   <mtu size="1442"/>
Aug 01 12:04:20 user nova-compute[72178]:   <target dev="tap9e38494f-00"/>
Aug 01 12:04:20 user nova-compute[72178]: </interface>
Aug 01 12:04:20 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.network.neutron [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updated VIF entry in instance network info cache for port 9e38494f-003a-4996-876e-69ae98f48743. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.network.neutron [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating instance_info_cache with network_info: [{"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Releasing lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received event network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Acquiring lock "98d39c47-5233-40b1-8d34-af244719fe52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] Lock "98d39c47-5233-40b1-8d34-af244719fe52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] No waiting events found dispatching network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:20 user nova-compute[72178]: WARNING nova.compute.manager [req-e97db028-235a-4975-a865-d779822739b8 req-d68443e1-ea80-43bb-8518-229aacf870be service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received unexpected event network-vif-plugged-3a03414e-614f-4b71-9eb7-36948736113c for instance with vm_state active and task_state deleting.
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No BDM found with device name hda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No VIF found with MAC fa:16:3e:66:5f:25, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:04:20 user nova-compute[72178]:   <nova:package version="0.0.0"/>
Aug 01 12:04:20 user nova-compute[72178]:   <nova:name>tempest-device-tagging-server-1539614270</nova:name>
Aug 01 12:04:20 user nova-compute[72178]:   <nova:creationTime>2023-08-01 12:04:20</nova:creationTime>
Aug 01 12:04:20 user nova-compute[72178]:   <nova:flavor name="m1.tiny">
Aug 01 12:04:20 user nova-compute[72178]:     <nova:memory>512</nova:memory>
Aug 01 12:04:20 user nova-compute[72178]:     <nova:disk>1</nova:disk>
Aug 01 12:04:20 user nova-compute[72178]:     <nova:swap>0</nova:swap>
Aug 01 12:04:20 user nova-compute[72178]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:04:20 user nova-compute[72178]:     <nova:vcpus>1</nova:vcpus>
Aug 01 12:04:20 user nova-compute[72178]:   </nova:flavor>
Aug 01 12:04:20 user nova-compute[72178]:   <nova:owner>
Aug 01 12:04:20 user nova-compute[72178]:     <nova:user uuid="7a73caf203ad4e8aaac7a1efb956c048">tempest-TaggedAttachmentsTest-1431933072-project-member</nova:user>
Aug 01 12:04:20 user nova-compute[72178]:     <nova:project uuid="a22155938fca465f904a75e3d0a1bd56">tempest-TaggedAttachmentsTest-1431933072</nova:project>
Aug 01 12:04:20 user nova-compute[72178]:   </nova:owner>
Aug 01 12:04:20 user nova-compute[72178]:   <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:04:20 user nova-compute[72178]:   <nova:ports>
Aug 01 12:04:20 user nova-compute[72178]:     <nova:port uuid="1c228670-844c-44a4-ad61-a9982fe910fd">
Aug 01 12:04:20 user nova-compute[72178]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:04:20 user nova-compute[72178]:     </nova:port>
Aug 01 12:04:20 user nova-compute[72178]:     <nova:port uuid="9e38494f-003a-4996-876e-69ae98f48743">
Aug 01 12:04:20 user nova-compute[72178]:       <nova:ip type="fixed" address="10.10.10.230" ipVersion="4"/>
Aug 01 12:04:20 user nova-compute[72178]:     </nova:port>
Aug 01 12:04:20 user nova-compute[72178]:   </nova:ports>
Aug 01 12:04:20 user nova-compute[72178]: </nova:instance>
Aug 01 12:04:20 user nova-compute[72178]:  {{(pid=72178) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-df70df19-552c-4477-9a82-c51fa0e4c882 req-ff256384-773c-454e-a26b-b023cedde075 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-df70df19-552c-4477-9a82-c51fa0e4c882 req-ff256384-773c-454e-a26b-b023cedde075 service nova] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-df70df19-552c-4477-9a82-c51fa0e4c882 req-ff256384-773c-454e-a26b-b023cedde075 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-df70df19-552c-4477-9a82-c51fa0e4c882 req-ff256384-773c-454e-a26b-b023cedde075 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-df70df19-552c-4477-9a82-c51fa0e4c882 req-ff256384-773c-454e-a26b-b023cedde075 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] No waiting events found dispatching network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:20 user nova-compute[72178]: WARNING nova.compute.manager [req-df70df19-552c-4477-9a82-c51fa0e4c882 req-ff256384-773c-454e-a26b-b023cedde075 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received unexpected event network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 for instance with vm_state active and task_state None.
Aug 01 12:04:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aab8494-1be2-4c49-8a58-224b08657c37 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "interface-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.298s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Took 1.50 seconds to deallocate network for instance.
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received event network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] Acquiring lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] No waiting events found dispatching network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:21 user nova-compute[72178]: WARNING nova.compute.manager [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received unexpected event network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 for instance with vm_state building and task_state spawning.
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received event network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] Acquiring lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] No waiting events found dispatching network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:21 user nova-compute[72178]: WARNING nova.compute.manager [req-6d4f01aa-34be-4c83-9f3f-06601ad25f4f req-d1c7a71f-e426-4c4b-b457-3ff7973b18d7 service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received unexpected event network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 for instance with vm_state building and task_state spawning.
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.objects.instance [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'flavor' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.compute.manager [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Attaching volume 6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 to /dev/vdb
Aug 01 12:04:21 user nova-compute[72178]: DEBUG os_brick.utils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a73ad9-4345-417a-bfee-83a25914a8e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d8b4d-8355-4d26-81ee-ee7083ae0f27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b0d752-539b-4bb1-bed3-a571d1ad83c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5126638c-d7f4-4d1a-88a4-243c91b39a3d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Deleted allocations for instance 98d39c47-5233-40b1-8d34-af244719fe52
Aug 01 12:04:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:04:21 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaad2fb-f0fb-4854-9536-75430e14e435]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG os_brick.utils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating existing volume attachment record: 119125e7-23ef-42e4-81b3-f1b8e80291ff {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891461.7251923, f4ae1965-8660-4deb-8427-cafa57f837c8 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] VM Resumed (Lifecycle Event)
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Instance spawned successfully.
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891461.7273557, f4ae1965-8660-4deb-8427-cafa57f837c8 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] VM Started (Lifecycle Event)
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:04:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07f6526e-ba9f-442a-963a-e6027dbcf182 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439 tempest-TestServerVolumeAttachScenarioOldVersion-2094198439-project-member] Lock "98d39c47-5233-40b1-8d34-af244719fe52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.879s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:04:21 user nova-compute[72178]: INFO nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Took 7.73 seconds to spawn the instance on the hypervisor.
Aug 01 12:04:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:22 user nova-compute[72178]: INFO nova.compute.manager [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Took 8.96 seconds to build instance.
Aug 01 12:04:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-21984a2d-519f-4ca0-a966-e887b83f0f34 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.088s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-b193c0a4-4828-4a36-a632-b2767a5600ac req-9d67e9cf-4a2b-4e1c-a08e-3d5670042a3b service nova] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Received event network-vif-deleted-3a03414e-614f-4b71-9eb7-36948736113c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-b193c0a4-4828-4a36-a632-b2767a5600ac req-9d67e9cf-4a2b-4e1c-a08e-3d5670042a3b service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b193c0a4-4828-4a36-a632-b2767a5600ac req-9d67e9cf-4a2b-4e1c-a08e-3d5670042a3b service nova] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b193c0a4-4828-4a36-a632-b2767a5600ac req-9d67e9cf-4a2b-4e1c-a08e-3d5670042a3b service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b193c0a4-4828-4a36-a632-b2767a5600ac req-9d67e9cf-4a2b-4e1c-a08e-3d5670042a3b service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-b193c0a4-4828-4a36-a632-b2767a5600ac req-9d67e9cf-4a2b-4e1c-a08e-3d5670042a3b service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] No waiting events found dispatching network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:22 user nova-compute[72178]: WARNING nova.compute.manager [req-b193c0a4-4828-4a36-a632-b2767a5600ac req-9d67e9cf-4a2b-4e1c-a08e-3d5670042a3b service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received unexpected event network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 for instance with vm_state active and task_state None.
Aug 01 12:04:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:26 user nova-compute[72178]: INFO nova.compute.manager [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Detaching volume 5545054f-c063-4ef2-a15e-30f1140065d3
Aug 01 12:04:26 user nova-compute[72178]: INFO nova.virt.block_device [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Attempting to driver detach volume 5545054f-c063-4ef2-a15e-30f1140065d3 from mountpoint /dev/vdc
Aug 01 12:04:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Attempting to detach device vdc from instance a378bfa5-d230-4e81-bc4f-16132501f1df from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:04:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:04:26 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:04:26 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:04:26 user nova-compute[72178]:   <target dev="vdc" bus="virtio"/>
Aug 01 12:04:26 user nova-compute[72178]:   <serial>5545054f-c063-4ef2-a15e-30f1140065d3</serial>
Aug 01 12:04:26 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 12:04:26 user nova-compute[72178]: </disk>
Aug 01 12:04:26 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:04:26 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully detached device vdc from instance a378bfa5-d230-4e81-bc4f-16132501f1df from the persistent domain config.
Aug 01 12:04:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a378bfa5-d230-4e81-bc4f-16132501f1df from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:04:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:04:26 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:04:26 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:04:26 user nova-compute[72178]:   <target dev="vdc" bus="virtio"/>
Aug 01 12:04:26 user nova-compute[72178]:   <serial>5545054f-c063-4ef2-a15e-30f1140065d3</serial>
Aug 01 12:04:26 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 12:04:26 user nova-compute[72178]: </disk>
Aug 01 12:04:26 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891467.039446, a378bfa5-d230-4e81-bc4f-16132501f1df => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:04:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully detached device vdc from instance a378bfa5-d230-4e81-bc4f-16132501f1df from the live domain config.
Aug 01 12:04:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gdXbBviW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:04:27 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2600336a-3ad9-4ef2-8b13-20a68f513fda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[249630a5-2595-4eee-a0f3-94de203f92fc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:27 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:27 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:04:27 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:27 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:27 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:27 user nova-compute[72178]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 (non-flash)
Aug 01 12:04:27 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:27 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f8d985e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1b7678-882b-43cf-a442-7c5bb87ed94e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f257270a-d1d2-4413-9e66-94107011a841]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22a9855-ff73-4979-a00b-8bb75418a5e2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c565d61b-4be2-4709-8cbe-ba74254be689]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2538e5c-6647-4420-8c05-192c7c3e3b86]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a683f26-34e6-4774-a870-49aa1c0ba98c]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3, portal: 172.16.0.220,3260]
Aug 01 12:04:27 user nova-compute[72178]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3, portal: 172.16.0.220,3260] successful.
Aug 01 12:04:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5545054f-c063-4ef2-a15e-30f1140065d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffb87bd-65d4-48bb-8d8b-65e52def7730]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] <== disconnect_volume: return (322ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:04:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:04:28 user nova-compute[72178]: DEBUG nova.objects.instance [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'flavor' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-def859ad-c44d-48d5-b114-ebc4dd319ca9 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.764s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:28 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:04:28 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=72178) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 12:04:29 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:04:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:29 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891455.3055148, a742f6ab-310e-4652-968d-7840febae699 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:04:30 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: a742f6ab-310e-4652-968d-7840febae699] VM Stopped (Lifecycle Event)
Aug 01 12:04:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a34f4979-f755-47e0-b7d3-f835e6d1dee3 None None] [instance: a742f6ab-310e-4652-968d-7840febae699] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPOufMzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:04:30 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:04:30 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:04:30 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32317c5-2ee5-4f0b-9003-c61be0898d9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:04:30 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[58391e95-ec2a-4476-acc6-4b2f841bc8a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1] added
Aug 01 12:04:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce1a800-0fe5-4e9a-a4b0-4a4023dbd440]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da851a-797e-4fce-bea1-efaf6b5c5aed]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPOufMzY {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPOufMzY" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac0040a-839a-4e8b-a95f-9dfcf4671bcd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPOufMzY'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be011ed-0dc3-4d65-835b-28fd660e1467]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5065ad3-939c-467b-9fcc-ae09f13a6d18]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7d4876-2ba7-428b-a946-daac06e6a7dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1, portal: 172.16.0.220,3260]
Aug 01 12:04:30 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1, portal: 172.16.0.220,3260] successful.
Aug 01 12:04:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fd0441-c78d-42c1-8c2c-bee25b60c4bb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b4f724-da0b-4532-8c39-2b8cdd828b15]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 (non-flash)
Aug 01 12:04:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65cb244-213d-48ba-bbe2-44dfd8014e2a]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPOufMzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23235613838393035', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235613838393035', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG nova.objects.instance [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'flavor' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:04:31 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:04:31 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:04:31 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:04:31 user nova-compute[72178]:   <serial>6b45fc90-c8ad-40a6-9d1f-3354be29d2f1</serial>
Aug 01 12:04:31 user nova-compute[72178]: </disk>
Aug 01 12:04:31 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No BDM found with device name hda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] No VIF found with MAC fa:16:3e:66:5f:25, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-112ec7ab-012d-4a6a-a0ff-38844b203bee tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.059s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891459.382519, 98d39c47-5233-40b1-8d34-af244719fe52 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:04:34 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] VM Stopped (Lifecycle Event)
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json" returned: 0 in 0.544s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2240a989-66b8-4405-bf5b-a9a99f9710ab None None] [instance: 98d39c47-5233-40b1-8d34-af244719fe52] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:34 user nova-compute[72178]: INFO nova.compute.manager [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Detaching volume 6b45fc90-c8ad-40a6-9d1f-3354be29d2f1
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:34 user nova-compute[72178]: INFO nova.virt.block_device [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Attempting to driver detach volume 6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 from mountpoint /dev/vdb
Aug 01 12:04:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Attempting to detach device vdb from instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:04:34 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:04:34 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:04:34 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:04:34 user nova-compute[72178]:   <serial>6b45fc90-c8ad-40a6-9d1f-3354be29d2f1</serial>
Aug 01 12:04:34 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 12:04:34 user nova-compute[72178]: </disk>
Aug 01 12:04:34 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:04:34 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Successfully detached device vdb from instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 from the persistent domain config.
Aug 01 12:04:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:04:34 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:04:34 user nova-compute[72178]:   <source dev="/dev/sde"/>
Aug 01 12:04:34 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:04:34 user nova-compute[72178]:   <serial>6b45fc90-c8ad-40a6-9d1f-3354be29d2f1</serial>
Aug 01 12:04:34 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 12:04:34 user nova-compute[72178]: </disk>
Aug 01 12:04:34 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891475.1812196, a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:04:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Successfully detached device vdb from instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 from the live domain config.
Aug 01 12:04:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPOufMzY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:04:35 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faac4aa-d030-445d-ad48-12b2adf55fc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3df7f6-d288-4c7d-bd1c-2ad95e55bbf9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:35 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:35 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:35 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:35 user nova-compute[72178]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 (non-flash)
Aug 01 12:04:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:35 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:35 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:35 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:35 user nova-compute[72178]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 (non-flash)
Aug 01 12:04:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f41680d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d7155-b9c3-48ca-825f-66f16ebd8bce]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:04:35 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:04:35 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=6804MB free_disk=25.26117706298828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[790fd84a-c165-431e-8855-60f708192ec2]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a3c0b7-f649-421f-b8a1-e921bf89ceb9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[23245e41-35ee-4b22-81ae-8917a28124af]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f8ba28-b510-4ee7-89b4-af3b21f5dc64]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:35 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Applying migration context for instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 as it has an incoming, in-progress migration 1d91194a-4719-46bd-a0e6-e42ff9d92795. Migration status is finished {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 12:04:35 user nova-compute[72178]: INFO nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating resource usage from migration 1d91194a-4719-46bd-a0e6-e42ff9d92795
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73194e9-7395-44a5-85b9-880125cefb06]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1, portal: 172.16.0.220,3260]
Aug 01 12:04:36 user nova-compute[72178]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1, portal: 172.16.0.220,3260] successful.
Aug 01 12:04:36 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 686d22d8-fae6-4035-aeac-c80cbeaff08b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance a378bfa5-d230-4e81-bc4f-16132501f1df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Migration 1d91194a-4719-46bd-a0e6-e42ff9d92795 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f4ae1965-8660-4deb-8427-cafa57f837c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b45fc90-c8ad-40a6-9d1f-3354be29d2f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[55463fcf-3949-4f2b-bbdf-a65b02340959]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.842s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] <== disconnect_volume: return (844ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] There are 0 instances to clean {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'flavor' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b05a5d2c-8286-4655-9e7f-a3244bcbb96c tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.570s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "interface-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-9e38494f-003a-4996-876e-69ae98f48743" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "interface-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-9e38494f-003a-4996-876e-69ae98f48743" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'flavor' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1539614270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1539614270',id=16,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3l0CrAp4blgm8p6J/CpMMmsynu7w4Q6ggCy2BAEuQiOvazPWA7Q9HgfC4YOhoX00X2/4A1muPlL6MCNEVU526AcZQkLN/mo9CJfWbPp2gR5FdDgha9mZBUuswKBX7xCA==',key_name='tempest-keypair-591392986',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a22155938fca465f904a75e3d0a1bd56',ramdisk_id='',reservation_id='r-yze31y42',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431933072',owner_user_name='tempest-TaggedAttachmentsTest-1431933072-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a73caf203ad4e8aaac7a1efb956c048',uuid=a42c3ebd-74a5-4745-a2a8-ade6b5636dc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converting VIF {"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:da:a8,bridge_name='br-int',has_traffic_filtering=True,id=9e38494f-003a-4996-876e-69ae98f48743,network=Network(cc2caa8b-611b-4796-a999-adfde4a6665b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38494f-00') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:da:a8"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e38494f-00"/></interface> {{(pid=72178) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:da:a8"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e38494f-00"/></interface> {{(pid=72178) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Attempting to detach device tap9e38494f-00 from instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] detach device xml: <interface type="ethernet">
Aug 01 12:04:37 user nova-compute[72178]:   <mac address="fa:16:3e:71:da:a8"/>
Aug 01 12:04:37 user nova-compute[72178]:   <model type="virtio"/>
Aug 01 12:04:37 user nova-compute[72178]:   <mtu size="1442"/>
Aug 01 12:04:37 user nova-compute[72178]:   <target dev="tap9e38494f-00"/>
Aug 01 12:04:37 user nova-compute[72178]: </interface>
Aug 01 12:04:37 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:da:a8"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e38494f-00"/></interface> {{(pid=72178) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:71:da:a8"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e38494f-00"/></interface>not found in domain: <domain type='kvm' id='17'>
Aug 01 12:04:37 user nova-compute[72178]:   <name>instance-00000010</name>
Aug 01 12:04:37 user nova-compute[72178]:   <uuid>a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</uuid>
Aug 01 12:04:37 user nova-compute[72178]:   <metadata>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:04:37 user nova-compute[72178]:   <nova:package version="0.0.0"/>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:name>tempest-device-tagging-server-1539614270</nova:name>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:creationTime>2023-08-01 12:04:20</nova:creationTime>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:flavor name="m1.tiny">
Aug 01 12:04:37 user nova-compute[72178]:     <nova:memory>512</nova:memory>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:disk>1</nova:disk>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:swap>0</nova:swap>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:vcpus>1</nova:vcpus>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:flavor>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:owner>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:user uuid="7a73caf203ad4e8aaac7a1efb956c048">tempest-TaggedAttachmentsTest-1431933072-project-member</nova:user>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:project uuid="a22155938fca465f904a75e3d0a1bd56">tempest-TaggedAttachmentsTest-1431933072</nova:project>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:owner>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:ports>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:port uuid="1c228670-844c-44a4-ad61-a9982fe910fd">
Aug 01 12:04:37 user nova-compute[72178]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:04:37 user nova-compute[72178]:     </nova:port>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:port uuid="9e38494f-003a-4996-876e-69ae98f48743">
Aug 01 12:04:37 user nova-compute[72178]:       <nova:ip type="fixed" address="10.10.10.230" ipVersion="4"/>
Aug 01 12:04:37 user nova-compute[72178]:     </nova:port>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:ports>
Aug 01 12:04:37 user nova-compute[72178]: </nova:instance>
Aug 01 12:04:37 user nova-compute[72178]:   </metadata>
Aug 01 12:04:37 user nova-compute[72178]:   <memory unit='KiB'>524288</memory>
Aug 01 12:04:37 user nova-compute[72178]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 12:04:37 user nova-compute[72178]:   <vcpu placement='static'>1</vcpu>
Aug 01 12:04:37 user nova-compute[72178]:   <resource>
Aug 01 12:04:37 user nova-compute[72178]:     <partition>/machine</partition>
Aug 01 12:04:37 user nova-compute[72178]:   </resource>
Aug 01 12:04:37 user nova-compute[72178]:   <sysinfo type='smbios'>
Aug 01 12:04:37 user nova-compute[72178]:     <system>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='version'>0.0.0</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='serial'>a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='uuid'>a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='family'>Virtual Machine</entry>
Aug 01 12:04:37 user nova-compute[72178]:     </system>
Aug 01 12:04:37 user nova-compute[72178]:   </sysinfo>
Aug 01 12:04:37 user nova-compute[72178]:   <os>
Aug 01 12:04:37 user nova-compute[72178]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 12:04:37 user nova-compute[72178]:     <boot dev='hd'/>
Aug 01 12:04:37 user nova-compute[72178]:     <smbios mode='sysinfo'/>
Aug 01 12:04:37 user nova-compute[72178]:   </os>
Aug 01 12:04:37 user nova-compute[72178]:   <features>
Aug 01 12:04:37 user nova-compute[72178]:     <acpi/>
Aug 01 12:04:37 user nova-compute[72178]:     <apic/>
Aug 01 12:04:37 user nova-compute[72178]:     <vmcoreinfo state='on'/>
Aug 01 12:04:37 user nova-compute[72178]:   </features>
Aug 01 12:04:37 user nova-compute[72178]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 12:04:37 user nova-compute[72178]:     <model fallback='forbid'>Nehalem</model>
Aug 01 12:04:37 user nova-compute[72178]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 12:04:37 user nova-compute[72178]:     <feature policy='require' name='vme'/>
Aug 01 12:04:37 user nova-compute[72178]:     <feature policy='require' name='x2apic'/>
Aug 01 12:04:37 user nova-compute[72178]:     <feature policy='require' name='hypervisor'/>
Aug 01 12:04:37 user nova-compute[72178]:   </cpu>
Aug 01 12:04:37 user nova-compute[72178]:   <clock offset='utc'>
Aug 01 12:04:37 user nova-compute[72178]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 12:04:37 user nova-compute[72178]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 12:04:37 user nova-compute[72178]:     <timer name='hpet' present='no'/>
Aug 01 12:04:37 user nova-compute[72178]:   </clock>
Aug 01 12:04:37 user nova-compute[72178]:   <on_poweroff>destroy</on_poweroff>
Aug 01 12:04:37 user nova-compute[72178]:   <on_reboot>restart</on_reboot>
Aug 01 12:04:37 user nova-compute[72178]:   <on_crash>destroy</on_crash>
Aug 01 12:04:37 user nova-compute[72178]:   <devices>
Aug 01 12:04:37 user nova-compute[72178]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 12:04:37 user nova-compute[72178]:     <disk type='file' device='disk'>
Aug 01 12:04:37 user nova-compute[72178]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 12:04:37 user nova-compute[72178]:       <source file='/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk' index='2'/>
Aug 01 12:04:37 user nova-compute[72178]:       <backingStore type='file' index='3'>
Aug 01 12:04:37 user nova-compute[72178]:         <format type='raw'/>
Aug 01 12:04:37 user nova-compute[72178]:         <source file='/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0'/>
Aug 01 12:04:37 user nova-compute[72178]:         <backingStore/>
Aug 01 12:04:37 user nova-compute[72178]:       </backingStore>
Aug 01 12:04:37 user nova-compute[72178]:       <target dev='vda' bus='virtio'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='virtio-disk0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </disk>
Aug 01 12:04:37 user nova-compute[72178]:     <disk type='file' device='cdrom'>
Aug 01 12:04:37 user nova-compute[72178]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 12:04:37 user nova-compute[72178]:       <source file='/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.config' index='1'/>
Aug 01 12:04:37 user nova-compute[72178]:       <backingStore/>
Aug 01 12:04:37 user nova-compute[72178]:       <target dev='hda' bus='ide'/>
Aug 01 12:04:37 user nova-compute[72178]:       <readonly/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='ide0-0-0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </disk>
Aug 01 12:04:37 user nova-compute[72178]:     <controller type='usb' index='0' model='none'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='usb'/>
Aug 01 12:04:37 user nova-compute[72178]:     </controller>
Aug 01 12:04:37 user nova-compute[72178]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='pci.0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </controller>
Aug 01 12:04:37 user nova-compute[72178]:     <controller type='ide' index='0'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='ide'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 12:04:37 user nova-compute[72178]:     </controller>
Aug 01 12:04:37 user nova-compute[72178]:     <interface type='ethernet'>
Aug 01 12:04:37 user nova-compute[72178]:       <mac address='fa:16:3e:66:5f:25'/>
Aug 01 12:04:37 user nova-compute[72178]:       <target dev='tap1c228670-84'/>
Aug 01 12:04:37 user nova-compute[72178]:       <model type='virtio'/>
Aug 01 12:04:37 user nova-compute[72178]:       <mtu size='1442'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='net0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </interface>
Aug 01 12:04:37 user nova-compute[72178]:     <interface type='ethernet'>
Aug 01 12:04:37 user nova-compute[72178]:       <mac address='fa:16:3e:71:da:a8'/>
Aug 01 12:04:37 user nova-compute[72178]:       <target dev='tap9e38494f-00'/>
Aug 01 12:04:37 user nova-compute[72178]:       <model type='virtio'/>
Aug 01 12:04:37 user nova-compute[72178]:       <mtu size='1442'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='net1'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </interface>
Aug 01 12:04:37 user nova-compute[72178]:     <serial type='pty'>
Aug 01 12:04:37 user nova-compute[72178]:       <source path='/dev/pts/11'/>
Aug 01 12:04:37 user nova-compute[72178]:       <log file='/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/console.log' append='off'/>
Aug 01 12:04:37 user nova-compute[72178]:       <target type='isa-serial' port='0'>
Aug 01 12:04:37 user nova-compute[72178]:         <model name='isa-serial'/>
Aug 01 12:04:37 user nova-compute[72178]:       </target>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='serial0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </serial>
Aug 01 12:04:37 user nova-compute[72178]:     <console type='pty' tty='/dev/pts/11'>
Aug 01 12:04:37 user nova-compute[72178]:       <source path='/dev/pts/11'/>
Aug 01 12:04:37 user nova-compute[72178]:       <log file='/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/console.log' append='off'/>
Aug 01 12:04:37 user nova-compute[72178]:       <target type='serial' port='0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='serial0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </console>
Aug 01 12:04:37 user nova-compute[72178]:     <input type='mouse' bus='ps2'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='input0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </input>
Aug 01 12:04:37 user nova-compute[72178]:     <input type='keyboard' bus='ps2'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='input1'/>
Aug 01 12:04:37 user nova-compute[72178]:     </input>
Aug 01 12:04:37 user nova-compute[72178]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 01 12:04:37 user nova-compute[72178]:       <listen type='address' address='0.0.0.0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </graphics>
Aug 01 12:04:37 user nova-compute[72178]:     <audio id='1' type='none'/>
Aug 01 12:04:37 user nova-compute[72178]:     <video>
Aug 01 12:04:37 user nova-compute[72178]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='video0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </video>
Aug 01 12:04:37 user nova-compute[72178]:     <memballoon model='virtio'>
Aug 01 12:04:37 user nova-compute[72178]:       <stats period='10'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='balloon0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </memballoon>
Aug 01 12:04:37 user nova-compute[72178]:     <rng model='virtio'>
Aug 01 12:04:37 user nova-compute[72178]:       <backend model='random'>/dev/urandom</backend>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='rng0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </rng>
Aug 01 12:04:37 user nova-compute[72178]:   </devices>
Aug 01 12:04:37 user nova-compute[72178]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 12:04:37 user nova-compute[72178]:     <label>libvirt-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</label>
Aug 01 12:04:37 user nova-compute[72178]:     <imagelabel>libvirt-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</imagelabel>
Aug 01 12:04:37 user nova-compute[72178]:   </seclabel>
Aug 01 12:04:37 user nova-compute[72178]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 12:04:37 user nova-compute[72178]:     <label>+64055:+108</label>
Aug 01 12:04:37 user nova-compute[72178]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 12:04:37 user nova-compute[72178]:   </seclabel>
Aug 01 12:04:37 user nova-compute[72178]: </domain>
Aug 01 12:04:37 user nova-compute[72178]:  {{(pid=72178) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 12:04:37 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Successfully detached device tap9e38494f-00 from instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 from the persistent domain config.
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] (1/8): Attempting to detach device tap9e38494f-00 with device alias net1 from instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] detach device xml: <interface type="ethernet">
Aug 01 12:04:37 user nova-compute[72178]:   <mac address="fa:16:3e:71:da:a8"/>
Aug 01 12:04:37 user nova-compute[72178]:   <model type="virtio"/>
Aug 01 12:04:37 user nova-compute[72178]:   <mtu size="1442"/>
Aug 01 12:04:37 user nova-compute[72178]:   <target dev="tap9e38494f-00"/>
Aug 01 12:04:37 user nova-compute[72178]: </interface>
Aug 01 12:04:37 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891477.7463565, a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Start waiting for the detach event from libvirt for device tap9e38494f-00 with device alias net1 for instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:71:da:a8"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e38494f-00"/></interface> {{(pid=72178) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:71:da:a8"/><model type="virtio"/><mtu size="1442"/><target dev="tap9e38494f-00"/></interface>not found in domain: <domain type='kvm' id='17'>
Aug 01 12:04:37 user nova-compute[72178]:   <name>instance-00000010</name>
Aug 01 12:04:37 user nova-compute[72178]:   <uuid>a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</uuid>
Aug 01 12:04:37 user nova-compute[72178]:   <metadata>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:04:37 user nova-compute[72178]:   <nova:package version="0.0.0"/>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:name>tempest-device-tagging-server-1539614270</nova:name>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:creationTime>2023-08-01 12:04:20</nova:creationTime>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:flavor name="m1.tiny">
Aug 01 12:04:37 user nova-compute[72178]:     <nova:memory>512</nova:memory>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:disk>1</nova:disk>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:swap>0</nova:swap>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:vcpus>1</nova:vcpus>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:flavor>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:owner>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:user uuid="7a73caf203ad4e8aaac7a1efb956c048">tempest-TaggedAttachmentsTest-1431933072-project-member</nova:user>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:project uuid="a22155938fca465f904a75e3d0a1bd56">tempest-TaggedAttachmentsTest-1431933072</nova:project>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:owner>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:ports>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:port uuid="1c228670-844c-44a4-ad61-a9982fe910fd">
Aug 01 12:04:37 user nova-compute[72178]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:04:37 user nova-compute[72178]:     </nova:port>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:port uuid="9e38494f-003a-4996-876e-69ae98f48743">
Aug 01 12:04:37 user nova-compute[72178]:       <nova:ip type="fixed" address="10.10.10.230" ipVersion="4"/>
Aug 01 12:04:37 user nova-compute[72178]:     </nova:port>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:ports>
Aug 01 12:04:37 user nova-compute[72178]: </nova:instance>
Aug 01 12:04:37 user nova-compute[72178]:   </metadata>
Aug 01 12:04:37 user nova-compute[72178]:   <memory unit='KiB'>524288</memory>
Aug 01 12:04:37 user nova-compute[72178]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 01 12:04:37 user nova-compute[72178]:   <vcpu placement='static'>1</vcpu>
Aug 01 12:04:37 user nova-compute[72178]:   <resource>
Aug 01 12:04:37 user nova-compute[72178]:     <partition>/machine</partition>
Aug 01 12:04:37 user nova-compute[72178]:   </resource>
Aug 01 12:04:37 user nova-compute[72178]:   <sysinfo type='smbios'>
Aug 01 12:04:37 user nova-compute[72178]:     <system>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='product'>OpenStack Nova</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='version'>0.0.0</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='serial'>a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='uuid'>a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</entry>
Aug 01 12:04:37 user nova-compute[72178]:       <entry name='family'>Virtual Machine</entry>
Aug 01 12:04:37 user nova-compute[72178]:     </system>
Aug 01 12:04:37 user nova-compute[72178]:   </sysinfo>
Aug 01 12:04:37 user nova-compute[72178]:   <os>
Aug 01 12:04:37 user nova-compute[72178]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 01 12:04:37 user nova-compute[72178]:     <boot dev='hd'/>
Aug 01 12:04:37 user nova-compute[72178]:     <smbios mode='sysinfo'/>
Aug 01 12:04:37 user nova-compute[72178]:   </os>
Aug 01 12:04:37 user nova-compute[72178]:   <features>
Aug 01 12:04:37 user nova-compute[72178]:     <acpi/>
Aug 01 12:04:37 user nova-compute[72178]:     <apic/>
Aug 01 12:04:37 user nova-compute[72178]:     <vmcoreinfo state='on'/>
Aug 01 12:04:37 user nova-compute[72178]:   </features>
Aug 01 12:04:37 user nova-compute[72178]:   <cpu mode='custom' match='exact' check='full'>
Aug 01 12:04:37 user nova-compute[72178]:     <model fallback='forbid'>Nehalem</model>
Aug 01 12:04:37 user nova-compute[72178]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 01 12:04:37 user nova-compute[72178]:     <feature policy='require' name='vme'/>
Aug 01 12:04:37 user nova-compute[72178]:     <feature policy='require' name='x2apic'/>
Aug 01 12:04:37 user nova-compute[72178]:     <feature policy='require' name='hypervisor'/>
Aug 01 12:04:37 user nova-compute[72178]:   </cpu>
Aug 01 12:04:37 user nova-compute[72178]:   <clock offset='utc'>
Aug 01 12:04:37 user nova-compute[72178]:     <timer name='pit' tickpolicy='delay'/>
Aug 01 12:04:37 user nova-compute[72178]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 01 12:04:37 user nova-compute[72178]:     <timer name='hpet' present='no'/>
Aug 01 12:04:37 user nova-compute[72178]:   </clock>
Aug 01 12:04:37 user nova-compute[72178]:   <on_poweroff>destroy</on_poweroff>
Aug 01 12:04:37 user nova-compute[72178]:   <on_reboot>restart</on_reboot>
Aug 01 12:04:37 user nova-compute[72178]:   <on_crash>destroy</on_crash>
Aug 01 12:04:37 user nova-compute[72178]:   <devices>
Aug 01 12:04:37 user nova-compute[72178]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 01 12:04:37 user nova-compute[72178]:     <disk type='file' device='disk'>
Aug 01 12:04:37 user nova-compute[72178]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 01 12:04:37 user nova-compute[72178]:       <source file='/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk' index='2'/>
Aug 01 12:04:37 user nova-compute[72178]:       <backingStore type='file' index='3'>
Aug 01 12:04:37 user nova-compute[72178]:         <format type='raw'/>
Aug 01 12:04:37 user nova-compute[72178]:         <source file='/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0'/>
Aug 01 12:04:37 user nova-compute[72178]:         <backingStore/>
Aug 01 12:04:37 user nova-compute[72178]:       </backingStore>
Aug 01 12:04:37 user nova-compute[72178]:       <target dev='vda' bus='virtio'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='virtio-disk0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </disk>
Aug 01 12:04:37 user nova-compute[72178]:     <disk type='file' device='cdrom'>
Aug 01 12:04:37 user nova-compute[72178]:       <driver name='qemu' type='raw' cache='none'/>
Aug 01 12:04:37 user nova-compute[72178]:       <source file='/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/disk.config' index='1'/>
Aug 01 12:04:37 user nova-compute[72178]:       <backingStore/>
Aug 01 12:04:37 user nova-compute[72178]:       <target dev='hda' bus='ide'/>
Aug 01 12:04:37 user nova-compute[72178]:       <readonly/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='ide0-0-0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </disk>
Aug 01 12:04:37 user nova-compute[72178]:     <controller type='usb' index='0' model='none'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='usb'/>
Aug 01 12:04:37 user nova-compute[72178]:     </controller>
Aug 01 12:04:37 user nova-compute[72178]:     <controller type='pci' index='0' model='pci-root'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='pci.0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </controller>
Aug 01 12:04:37 user nova-compute[72178]:     <controller type='ide' index='0'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='ide'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 01 12:04:37 user nova-compute[72178]:     </controller>
Aug 01 12:04:37 user nova-compute[72178]:     <interface type='ethernet'>
Aug 01 12:04:37 user nova-compute[72178]:       <mac address='fa:16:3e:66:5f:25'/>
Aug 01 12:04:37 user nova-compute[72178]:       <target dev='tap1c228670-84'/>
Aug 01 12:04:37 user nova-compute[72178]:       <model type='virtio'/>
Aug 01 12:04:37 user nova-compute[72178]:       <mtu size='1442'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='net0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </interface>
Aug 01 12:04:37 user nova-compute[72178]:     <serial type='pty'>
Aug 01 12:04:37 user nova-compute[72178]:       <source path='/dev/pts/11'/>
Aug 01 12:04:37 user nova-compute[72178]:       <log file='/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/console.log' append='off'/>
Aug 01 12:04:37 user nova-compute[72178]:       <target type='isa-serial' port='0'>
Aug 01 12:04:37 user nova-compute[72178]:         <model name='isa-serial'/>
Aug 01 12:04:37 user nova-compute[72178]:       </target>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='serial0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </serial>
Aug 01 12:04:37 user nova-compute[72178]:     <console type='pty' tty='/dev/pts/11'>
Aug 01 12:04:37 user nova-compute[72178]:       <source path='/dev/pts/11'/>
Aug 01 12:04:37 user nova-compute[72178]:       <log file='/opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4/console.log' append='off'/>
Aug 01 12:04:37 user nova-compute[72178]:       <target type='serial' port='0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='serial0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </console>
Aug 01 12:04:37 user nova-compute[72178]:     <input type='mouse' bus='ps2'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='input0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </input>
Aug 01 12:04:37 user nova-compute[72178]:     <input type='keyboard' bus='ps2'>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='input1'/>
Aug 01 12:04:37 user nova-compute[72178]:     </input>
Aug 01 12:04:37 user nova-compute[72178]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 01 12:04:37 user nova-compute[72178]:       <listen type='address' address='0.0.0.0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </graphics>
Aug 01 12:04:37 user nova-compute[72178]:     <audio id='1' type='none'/>
Aug 01 12:04:37 user nova-compute[72178]:     <video>
Aug 01 12:04:37 user nova-compute[72178]:       <model type='virtio' heads='1' primary='yes'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='video0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </video>
Aug 01 12:04:37 user nova-compute[72178]:     <memballoon model='virtio'>
Aug 01 12:04:37 user nova-compute[72178]:       <stats period='10'/>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='balloon0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </memballoon>
Aug 01 12:04:37 user nova-compute[72178]:     <rng model='virtio'>
Aug 01 12:04:37 user nova-compute[72178]:       <backend model='random'>/dev/urandom</backend>
Aug 01 12:04:37 user nova-compute[72178]:       <alias name='rng0'/>
Aug 01 12:04:37 user nova-compute[72178]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 01 12:04:37 user nova-compute[72178]:     </rng>
Aug 01 12:04:37 user nova-compute[72178]:   </devices>
Aug 01 12:04:37 user nova-compute[72178]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 01 12:04:37 user nova-compute[72178]:     <label>libvirt-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</label>
Aug 01 12:04:37 user nova-compute[72178]:     <imagelabel>libvirt-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4</imagelabel>
Aug 01 12:04:37 user nova-compute[72178]:   </seclabel>
Aug 01 12:04:37 user nova-compute[72178]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 01 12:04:37 user nova-compute[72178]:     <label>+64055:+108</label>
Aug 01 12:04:37 user nova-compute[72178]:     <imagelabel>+64055:+108</imagelabel>
Aug 01 12:04:37 user nova-compute[72178]:   </seclabel>
Aug 01 12:04:37 user nova-compute[72178]: </domain>
Aug 01 12:04:37 user nova-compute[72178]:  {{(pid=72178) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 01 12:04:37 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Successfully detached device tap9e38494f-00 from instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 from the live domain config.
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1539614270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1539614270',id=16,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3l0CrAp4blgm8p6J/CpMMmsynu7w4Q6ggCy2BAEuQiOvazPWA7Q9HgfC4YOhoX00X2/4A1muPlL6MCNEVU526AcZQkLN/mo9CJfWbPp2gR5FdDgha9mZBUuswKBX7xCA==',key_name='tempest-keypair-591392986',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a22155938fca465f904a75e3d0a1bd56',ramdisk_id='',reservation_id='r-yze31y42',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431933072',owner_user_name='tempest-TaggedAttachmentsTest-1431933072-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a73caf203ad4e8aaac7a1efb956c048',uuid=a42c3ebd-74a5-4745-a2a8-ade6b5636dc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converting VIF {"id": "9e38494f-003a-4996-876e-69ae98f48743", "address": "fa:16:3e:71:da:a8", "network": {"id": "cc2caa8b-611b-4796-a999-adfde4a6665b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-712806789", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e38494f-00", "ovs_interfaceid": "9e38494f-003a-4996-876e-69ae98f48743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:da:a8,bridge_name='br-int',has_traffic_filtering=True,id=9e38494f-003a-4996-876e-69ae98f48743,network=Network(cc2caa8b-611b-4796-a999-adfde4a6665b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38494f-00') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG os_vif [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:da:a8,bridge_name='br-int',has_traffic_filtering=True,id=9e38494f-003a-4996-876e-69ae98f48743,network=Network(cc2caa8b-611b-4796-a999-adfde4a6665b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38494f-00') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e38494f-00, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:37 user nova-compute[72178]: INFO os_vif [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:da:a8,bridge_name='br-int',has_traffic_filtering=True,id=9e38494f-003a-4996-876e-69ae98f48743,network=Network(cc2caa8b-611b-4796-a999-adfde4a6665b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e38494f-00')
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:04:37 user nova-compute[72178]:   <nova:package version="0.0.0"/>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:name>tempest-device-tagging-server-1539614270</nova:name>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:creationTime>2023-08-01 12:04:37</nova:creationTime>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:flavor name="m1.tiny">
Aug 01 12:04:37 user nova-compute[72178]:     <nova:memory>512</nova:memory>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:disk>1</nova:disk>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:swap>0</nova:swap>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:vcpus>1</nova:vcpus>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:flavor>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:owner>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:user uuid="7a73caf203ad4e8aaac7a1efb956c048">tempest-TaggedAttachmentsTest-1431933072-project-member</nova:user>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:project uuid="a22155938fca465f904a75e3d0a1bd56">tempest-TaggedAttachmentsTest-1431933072</nova:project>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:owner>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:04:37 user nova-compute[72178]:   <nova:ports>
Aug 01 12:04:37 user nova-compute[72178]:     <nova:port uuid="1c228670-844c-44a4-ad61-a9982fe910fd">
Aug 01 12:04:37 user nova-compute[72178]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:04:37 user nova-compute[72178]:     </nova:port>
Aug 01 12:04:37 user nova-compute[72178]:   </nova:ports>
Aug 01 12:04:37 user nova-compute[72178]: </nova:instance>
Aug 01 12:04:37 user nova-compute[72178]:  {{(pid=72178) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-d02ddeea-6dc4-4891-af24-4dfc5c5e62af req-01a8329b-7fb0-4519-905a-5ede21860858 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-unplugged-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d02ddeea-6dc4-4891-af24-4dfc5c5e62af req-01a8329b-7fb0-4519-905a-5ede21860858 service nova] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d02ddeea-6dc4-4891-af24-4dfc5c5e62af req-01a8329b-7fb0-4519-905a-5ede21860858 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d02ddeea-6dc4-4891-af24-4dfc5c5e62af req-01a8329b-7fb0-4519-905a-5ede21860858 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-d02ddeea-6dc4-4891-af24-4dfc5c5e62af req-01a8329b-7fb0-4519-905a-5ede21860858 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] No waiting events found dispatching network-vif-unplugged-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:37 user nova-compute[72178]: WARNING nova.compute.manager [req-d02ddeea-6dc4-4891-af24-4dfc5c5e62af req-01a8329b-7fb0-4519-905a-5ede21860858 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received unexpected event network-vif-unplugged-9e38494f-003a-4996-876e-69ae98f48743 for instance with vm_state active and task_state None.
Aug 01 12:04:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquired lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:38 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:04:39 user nova-compute[72178]: INFO nova.network.neutron [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Port 9e38494f-003a-4996-876e-69ae98f48743 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 01 12:04:39 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating instance_info_cache with network_info: [{"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Releasing lock "refresh_cache-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a7fa2f6-edd9-48a7-b054-7c87b4b1be84 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "interface-a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-9e38494f-003a-4996-876e-69ae98f48743" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.031s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:39 user nova-compute[72178]: INFO nova.compute.manager [None req-c6a22ebc-8b2b-4df3-869e-b4a45e2ebd03 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Unrescuing
Aug 01 12:04:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c6a22ebc-8b2b-4df3-869e-b4a45e2ebd03 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c6a22ebc-8b2b-4df3-869e-b4a45e2ebd03 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquired lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:39 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c6a22ebc-8b2b-4df3-869e-b4a45e2ebd03 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-7ffda268-d0cf-479e-8e30-ec4576219d6a req-1c9ef889-aa76-47cb-b016-38e41f397166 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7ffda268-d0cf-479e-8e30-ec4576219d6a req-1c9ef889-aa76-47cb-b016-38e41f397166 service nova] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7ffda268-d0cf-479e-8e30-ec4576219d6a req-1c9ef889-aa76-47cb-b016-38e41f397166 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7ffda268-d0cf-479e-8e30-ec4576219d6a req-1c9ef889-aa76-47cb-b016-38e41f397166 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-7ffda268-d0cf-479e-8e30-ec4576219d6a req-1c9ef889-aa76-47cb-b016-38e41f397166 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] No waiting events found dispatching network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:40 user nova-compute[72178]: WARNING nova.compute.manager [req-7ffda268-d0cf-479e-8e30-ec4576219d6a req-1c9ef889-aa76-47cb-b016-38e41f397166 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received unexpected event network-vif-plugged-9e38494f-003a-4996-876e-69ae98f48743 for instance with vm_state active and task_state None.
Aug 01 12:04:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-7ffda268-d0cf-479e-8e30-ec4576219d6a req-1c9ef889-aa76-47cb-b016-38e41f397166 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-deleted-9e38494f-003a-4996-876e-69ae98f48743 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c6a22ebc-8b2b-4df3-869e-b4a45e2ebd03 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c6a22ebc-8b2b-4df3-869e-b4a45e2ebd03 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Releasing lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c6a22ebc-8b2b-4df3-869e-b4a45e2ebd03 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'flavor' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-3957f75a-27d3-4a24-8b56-3482c6aceea3 req-f454f69f-3dff-4298-8add-5f92d267f48b service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3957f75a-27d3-4a24-8b56-3482c6aceea3 req-f454f69f-3dff-4298-8add-5f92d267f48b service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3957f75a-27d3-4a24-8b56-3482c6aceea3 req-f454f69f-3dff-4298-8add-5f92d267f48b service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3957f75a-27d3-4a24-8b56-3482c6aceea3 req-f454f69f-3dff-4298-8add-5f92d267f48b service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-3957f75a-27d3-4a24-8b56-3482c6aceea3 req-f454f69f-3dff-4298-8add-5f92d267f48b service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:40 user nova-compute[72178]: WARNING nova.compute.manager [req-3957f75a-27d3-4a24-8b56-3482c6aceea3 req-f454f69f-3dff-4298-8add-5f92d267f48b service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:04:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance destroyed successfully.
Aug 01 12:04:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:42 user nova-compute[72178]: WARNING nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:04:42 user nova-compute[72178]: DEBUG nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-changed-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Refreshing instance network info cache due to event network-changed-af72e448-83b0-4bec-8ead-79148cc4213c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Acquiring lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Acquired lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG nova.network.neutron [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Refreshing network info cache for port af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:04:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.network.neutron [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updated VIF entry in instance network info cache for port af72e448-83b0-4bec-8ead-79148cc4213c. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.network.neutron [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Releasing lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-changed-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Refreshing instance network info cache due to event network-changed-af72e448-83b0-4bec-8ead-79148cc4213c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Acquiring lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Acquired lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.network.neutron [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Refreshing network info cache for port af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.network.neutron [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updated VIF entry in instance network info cache for port af72e448-83b0-4bec-8ead-79148cc4213c. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.network.neutron [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [{"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Releasing lock "refresh_cache-96c961db-b50d-45c9-bc4f-0c594b5a6c2d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:43 user nova-compute[72178]: WARNING nova.compute.manager [req-9499d56d-48e4-4e3a-be6e-1a9e0c183e0a req-c610d7b0-81ef-4f8d-997b-44af4ee5819a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for 96c961db-b50d-45c9-bc4f-0c594b5a6c2d due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891484.7746131, 96c961db-b50d-45c9-bc4f-0c594b5a6c2d => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:04:44 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] VM Resumed (Lifecycle Event)
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c6a22ebc-8b2b-4df3-869e-b4a45e2ebd03 tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:04:44 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891484.7885528, 96c961db-b50d-45c9-bc4f-0c594b5a6c2d => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:04:44 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] VM Started (Lifecycle Event)
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-e42a14ae-0184-4f2a-ad55-1911b140910a req-3a44c7e1-de1e-4fe6-a782-448704e3226f service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e42a14ae-0184-4f2a-ad55-1911b140910a req-3a44c7e1-de1e-4fe6-a782-448704e3226f service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e42a14ae-0184-4f2a-ad55-1911b140910a req-3a44c7e1-de1e-4fe6-a782-448704e3226f service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e42a14ae-0184-4f2a-ad55-1911b140910a req-3a44c7e1-de1e-4fe6-a782-448704e3226f service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-e42a14ae-0184-4f2a-ad55-1911b140910a req-3a44c7e1-de1e-4fe6-a782-448704e3226f service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:44 user nova-compute[72178]: WARNING nova.compute.manager [req-e42a14ae-0184-4f2a-ad55-1911b140910a req-3a44c7e1-de1e-4fe6-a782-448704e3226f service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state active and task_state None.
Aug 01 12:04:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Port 5f9f171c-75e5-4362-8075-9051f6fbcabe binding to destination host user is already ACTIVE {{(pid=72178) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquired lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Releasing lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Creating tmpfile /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/tmpby4l2cru to verify with other compute node that the instance is on the same shared storage. {{(pid=72178) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-3cf15100-4ee4-4697-a4b9-3db84d405f34 req-ad36238b-5112-414f-a2a4-b4c133477b49 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3cf15100-4ee4-4697-a4b9-3db84d405f34 req-ad36238b-5112-414f-a2a4-b4c133477b49 service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3cf15100-4ee4-4697-a4b9-3db84d405f34 req-ad36238b-5112-414f-a2a4-b4c133477b49 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3cf15100-4ee4-4697-a4b9-3db84d405f34 req-ad36238b-5112-414f-a2a4-b4c133477b49 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-3cf15100-4ee4-4697-a4b9-3db84d405f34 req-ad36238b-5112-414f-a2a4-b4c133477b49 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:53 user nova-compute[72178]: WARNING nova.compute.manager [req-3cf15100-4ee4-4697-a4b9-3db84d405f34 req-ad36238b-5112-414f-a2a4-b4c133477b49 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state resized and task_state resize_reverting.
Aug 01 12:04:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance destroyed successfully.
Aug 01 12:04:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'resources' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:03:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_vif [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9f171c-75, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:53 user nova-compute[72178]: INFO os_vif [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75')
Aug 01 12:04:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:04:53 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef1cd06-120d-4b6e-af25-0269e5c6d320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a969f6-912e-49d2-9d25-18fdc241cf65]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:53 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:53 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:53 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:04:53 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:04:53 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:04:53 user nova-compute[72178]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:04:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040ca4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'): ({'sdg'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Removing single pathed devices sdg {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c561fc-1a03-46f8-8142-f622bbb24919]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aa0b37-e1a8-469b-870b-653d1f4fb178]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flushing IO for device /dev/sdg {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[01351969-d53f-4a60-a074-6bd96414168d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4781042f-b5c6-44c7-b7bc-c24dc408a3c6]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] SCSI volumes sdg have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e0d4be-5813-4e61-aa84-9e85657c3a3b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e63b40-2e40-404a-9344-40e1dee7e851]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]
Aug 01 12:04:53 user nova-compute[72178]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.
Aug 01 12:04:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bcc8b8-02fa-4755-a808-709be2fa4de0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== disconnect_volume: return (314ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:04:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:04:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'migration_context' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-b91980f8-f52b-475c-9125-0cd3d4c4f2b8 req-72de7442-114f-4a69-a4c2-89c7c949e112 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b91980f8-f52b-475c-9125-0cd3d4c4f2b8 req-72de7442-114f-4a69-a4c2-89c7c949e112 service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b91980f8-f52b-475c-9125-0cd3d4c4f2b8 req-72de7442-114f-4a69-a4c2-89c7c949e112 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b91980f8-f52b-475c-9125-0cd3d4c4f2b8 req-72de7442-114f-4a69-a4c2-89c7c949e112 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-b91980f8-f52b-475c-9125-0cd3d4c4f2b8 req-72de7442-114f-4a69-a4c2-89c7c949e112 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:04:55 user nova-compute[72178]: WARNING nova.compute.manager [req-b91980f8-f52b-475c-9125-0cd3d4c4f2b8 req-72de7442-114f-4a69-a4c2-89c7c949e112 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state resized and task_state resize_reverting.
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Refreshing inventories for resource provider f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Updating ProviderTree inventory for provider f106307e-ff81-42a0-bae9-51f40c919103 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Refreshing aggregate associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, aggregates: None {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Refreshing trait associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:04:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.036s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:04:56 user nova-compute[72178]: INFO nova.compute.manager [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Swapping old allocation on dict_keys(['f106307e-ff81-42a0-bae9-51f40c919103']) held by migration 1d91194a-4719-46bd-a0e6-e42ff9d92795 for instance
Aug 01 12:04:56 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Overwriting current allocation {'allocations': {'f106307e-ff81-42a0-bae9-51f40c919103': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': 'b58e90c2bb974b6a9be977ac0ce46828', 'user_id': '57295306c0f44b0db27c9eb0c3ac8b6b', 'consumer_generation': 1} on consumer f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquired lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Releasing lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG os_brick.utils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3483ff0f-0d23-4b6b-b065-e26facb05372]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8af03ff-1055-4526-be4b-5bdcdf7fc4f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ffb26b-91de-4bad-87c1-f6f417add035]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e55212-ba8f-4cd2-9217-b89e112b016f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:04:56 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:04:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d578b605-354e-40e6-9af2-85aacc7a7e56]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:04:56 user nova-compute[72178]: DEBUG os_brick.utils [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:04:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:04:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Starting finish_revert_migration {{(pid=72178) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Start _get_guest_xml network_info=[{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f75a07e7-7cd8-4a63-b03d-422e07da25f8', 'attached_at': '2023-08-01T12:05:05.000000', 'detached_at': '', 'volume_id': 'a06acd6f-2445-445a-98b0-a6811ac35625', 'serial': 'a06acd6f-2445-445a-98b0-a6811ac35625'}, 'boot_index': None, 'attachment_id': 'ab182453-2143-49a4-9f0e-13c9c1bd1d08', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:05:04 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:05:04 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'vcpu_model' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:05:04 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:05:04 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:05:04 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d23ce6-a373-4872-a829-386e09c2283c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:05:04 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6689045a-09db-448f-a487-4b2cf2c68267]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625] added
Aug 01 12:05:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82add7c-b34e-4b6c-a38f-f64314e256fd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18fa3b9-6255-4e83-aaed-fb5d8dc65424]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKRJbqnS {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKRJbqnS" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6a4040-3ac9-41f5-8133-3922edd9ae4c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKRJbqnS'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[94efc758-0298-4463-81a2-ff29afeb2b6f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e83673-f2b8-42f9-ad1e-5bc66bb7d58c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:05:04 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:05:04 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:05:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:05:04 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:05:04 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:05:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc0013e-09cf-4600-8fad-f147e58e5902]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]
Aug 01 12:05:04 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.
Aug 01 12:05:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[162c783f-3132-4258-b95e-81fc881a0fcb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[46daa040-df1a-4d62-b4fc-297bdda6dfb6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:05:05 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:05:05 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:05:05 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:05:05 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:05:05 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:05:05 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:05:05 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:05:05 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2778f7-be0f-4a0c-96d9-6698ca4dbe17]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:05 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23736313333376235', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736313333376235', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:04:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:05:06 user nova-compute[72178]:   <uuid>f75a07e7-7cd8-4a63-b03d-422e07da25f8</uuid>
Aug 01 12:05:06 user nova-compute[72178]:   <name>instance-00000008</name>
Aug 01 12:05:06 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:05:06 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:05:06 user nova-compute[72178]:   <metadata>
Aug 01 12:05:06 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:05:06 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:05:06 user nova-compute[72178]:       <nova:name>tempest-ServerActionsTestOtherB-server-1304452031</nova:name>
Aug 01 12:05:06 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:05:04</nova:creationTime>
Aug 01 12:05:06 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:05:06 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:05:06 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:05:06 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:05:06 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:05:06 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:05:06 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:05:06 user nova-compute[72178]:       <nova:owner>
Aug 01 12:05:06 user nova-compute[72178]:         <nova:user uuid="57295306c0f44b0db27c9eb0c3ac8b6b">tempest-ServerActionsTestOtherB-2113691896-project-member</nova:user>
Aug 01 12:05:06 user nova-compute[72178]:         <nova:project uuid="b58e90c2bb974b6a9be977ac0ce46828">tempest-ServerActionsTestOtherB-2113691896</nova:project>
Aug 01 12:05:06 user nova-compute[72178]:       </nova:owner>
Aug 01 12:05:06 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:05:06 user nova-compute[72178]:       <nova:ports>
Aug 01 12:05:06 user nova-compute[72178]:         <nova:port uuid="5f9f171c-75e5-4362-8075-9051f6fbcabe">
Aug 01 12:05:06 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:05:06 user nova-compute[72178]:         </nova:port>
Aug 01 12:05:06 user nova-compute[72178]:       </nova:ports>
Aug 01 12:05:06 user nova-compute[72178]:     </nova:instance>
Aug 01 12:05:06 user nova-compute[72178]:   </metadata>
Aug 01 12:05:06 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:05:06 user nova-compute[72178]:     <system>
Aug 01 12:05:06 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:05:06 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:05:06 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:05:06 user nova-compute[72178]:       <entry name="serial">f75a07e7-7cd8-4a63-b03d-422e07da25f8</entry>
Aug 01 12:05:06 user nova-compute[72178]:       <entry name="uuid">f75a07e7-7cd8-4a63-b03d-422e07da25f8</entry>
Aug 01 12:05:06 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:05:06 user nova-compute[72178]:     </system>
Aug 01 12:05:06 user nova-compute[72178]:   </sysinfo>
Aug 01 12:05:06 user nova-compute[72178]:   <os>
Aug 01 12:05:06 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:05:06 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:05:06 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:05:06 user nova-compute[72178]:   </os>
Aug 01 12:05:06 user nova-compute[72178]:   <features>
Aug 01 12:05:06 user nova-compute[72178]:     <acpi/>
Aug 01 12:05:06 user nova-compute[72178]:     <apic/>
Aug 01 12:05:06 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:05:06 user nova-compute[72178]:   </features>
Aug 01 12:05:06 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:05:06 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:05:06 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:05:06 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:05:06 user nova-compute[72178]:   </clock>
Aug 01 12:05:06 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:05:06 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:05:06 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:05:06 user nova-compute[72178]:   </cpu>
Aug 01 12:05:06 user nova-compute[72178]:   <devices>
Aug 01 12:05:06 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:05:06 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:05:06 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk"/>
Aug 01 12:05:06 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:05:06 user nova-compute[72178]:     </disk>
Aug 01 12:05:06 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:05:06 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:05:06 user nova-compute[72178]:       <source dev="/dev/sde"/>
Aug 01 12:05:06 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:05:06 user nova-compute[72178]:       <serial>a06acd6f-2445-445a-98b0-a6811ac35625</serial>
Aug 01 12:05:06 user nova-compute[72178]:     </disk>
Aug 01 12:05:06 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:05:06 user nova-compute[72178]:       <mac address="fa:16:3e:3b:c9:93"/>
Aug 01 12:05:06 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:05:06 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:05:06 user nova-compute[72178]:       <target dev="tap5f9f171c-75"/>
Aug 01 12:05:06 user nova-compute[72178]:     </interface>
Aug 01 12:05:06 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:05:06 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/console.log" append="off"/>
Aug 01 12:05:06 user nova-compute[72178]:     </serial>
Aug 01 12:05:06 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:05:06 user nova-compute[72178]:     <video>
Aug 01 12:05:06 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:05:06 user nova-compute[72178]:     </video>
Aug 01 12:05:06 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:05:06 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:05:06 user nova-compute[72178]:     </rng>
Aug 01 12:05:06 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:05:06 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:05:06 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:05:06 user nova-compute[72178]:     </memballoon>
Aug 01 12:05:06 user nova-compute[72178]:   </devices>
Aug 01 12:05:06 user nova-compute[72178]: </domain>
Aug 01 12:05:06 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:04:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG os_vif [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f9f171c-75, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f9f171c-75, col_values=(('external_ids', {'iface-id': '5f9f171c-75e5-4362-8075-9051f6fbcabe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:c9:93', 'vm-uuid': 'f75a07e7-7cd8-4a63-b03d-422e07da25f8'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:05:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:06 user nova-compute[72178]: INFO os_vif [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75')
Aug 01 12:05:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-e69d4b46-630c-4f4a-be68-25adcf255c62 req-1dcacba8-ff95-475a-8765-506ed116568e service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e69d4b46-630c-4f4a-be68-25adcf255c62 req-1dcacba8-ff95-475a-8765-506ed116568e service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e69d4b46-630c-4f4a-be68-25adcf255c62 req-1dcacba8-ff95-475a-8765-506ed116568e service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e69d4b46-630c-4f4a-be68-25adcf255c62 req-1dcacba8-ff95-475a-8765-506ed116568e service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-e69d4b46-630c-4f4a-be68-25adcf255c62 req-1dcacba8-ff95-475a-8765-506ed116568e service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:07 user nova-compute[72178]: WARNING nova.compute.manager [req-e69d4b46-630c-4f4a-be68-25adcf255c62 req-1dcacba8-ff95-475a-8765-506ed116568e service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state resized and task_state resize_reverting.
Aug 01 12:05:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:08 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891493.6002338, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:08 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Stopped (Lifecycle Event)
Aug 01 12:05:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-20a20884-ddc4-435f-be16-01737904dce0 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891509.534351, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Resumed (Lifecycle Event)
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:05:09 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance running successfully.
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] finish_revert_migration finished successfully. {{(pid=72178) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:05:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891509.5361762, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Started (Lifecycle Event)
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:05:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.compute.manager [req-d3b070cb-6a5b-40ac-b5df-73aea89d26c1 req-a87d0aa9-95ec-4f16-a1e4-8895cf04407e service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d3b070cb-6a5b-40ac-b5df-73aea89d26c1 req-a87d0aa9-95ec-4f16-a1e4-8895cf04407e service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d3b070cb-6a5b-40ac-b5df-73aea89d26c1 req-a87d0aa9-95ec-4f16-a1e4-8895cf04407e service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d3b070cb-6a5b-40ac-b5df-73aea89d26c1 req-a87d0aa9-95ec-4f16-a1e4-8895cf04407e service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:09 user nova-compute[72178]: DEBUG nova.compute.manager [req-d3b070cb-6a5b-40ac-b5df-73aea89d26c1 req-a87d0aa9-95ec-4f16-a1e4-8895cf04407e service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:09 user nova-compute[72178]: WARNING nova.compute.manager [req-d3b070cb-6a5b-40ac-b5df-73aea89d26c1 req-a87d0aa9-95ec-4f16-a1e4-8895cf04407e service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state resized and task_state resize_reverting.
Aug 01 12:05:09 user nova-compute[72178]: INFO nova.compute.manager [None req-6005adf2-e3d4-49f9-bddf-a85af77d1207 tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance to original state: 'active'
Aug 01 12:05:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:10 user nova-compute[72178]: INFO nova.compute.manager [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Terminating instance
Aug 01 12:05:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa488393-9ed8-435c-9e67-0c3baeee53a4 req-f113213d-b11e-4215-83f8-8e60532dd578 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received event network-vif-unplugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa488393-9ed8-435c-9e67-0c3baeee53a4 req-f113213d-b11e-4215-83f8-8e60532dd578 service nova] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa488393-9ed8-435c-9e67-0c3baeee53a4 req-f113213d-b11e-4215-83f8-8e60532dd578 service nova] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa488393-9ed8-435c-9e67-0c3baeee53a4 req-f113213d-b11e-4215-83f8-8e60532dd578 service nova] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa488393-9ed8-435c-9e67-0c3baeee53a4 req-f113213d-b11e-4215-83f8-8e60532dd578 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] No waiting events found dispatching network-vif-unplugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa488393-9ed8-435c-9e67-0c3baeee53a4 req-f113213d-b11e-4215-83f8-8e60532dd578 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received event network-vif-unplugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:05:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Instance destroyed successfully.
Aug 01 12:05:11 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lazy-loading 'resources' on Instance uuid 686d22d8-fae6-4035-aeac-c80cbeaff08b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1609867349',display_name='tempest-VolumesAdminNegativeTest-server-1609867349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1609867349',id=9,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgliz1YtqKtyQZHs1ti6i/RMoqx3mKNW2JtKnNjUUB9AX0oaVbXcWL/JDkqzMkDOHgLfSvlbDTYOa1BRjsokhoIgHouQCP3JcB9kcguuVnN9iqrqe03VA4fmJs7Ezl79g==',key_name='tempest-keypair-581068206',keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='966cb02845ea40aea6b64cabe1f600c2',ramdisk_id='',reservation_id='r-zyhqzvo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1802258801',owner_user_name='tempest-VolumesAdminNegativeTest-1802258801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T11:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc6bcb5e39f04635abbc68fcddfcf8d1',uuid=686d22d8-fae6-4035-aeac-c80cbeaff08b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converting VIF {"id": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "address": "fa:16:3e:66:64:12", "network": {"id": "413ea4a6-8bff-40c7-ae4d-3bc119977885", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1849574765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "966cb02845ea40aea6b64cabe1f600c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97b9bcbd-44", "ovs_interfaceid": "97b9bcbd-4448-4211-a3df-f3e08a41f14e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:64:12,bridge_name='br-int',has_traffic_filtering=True,id=97b9bcbd-4448-4211-a3df-f3e08a41f14e,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b9bcbd-44') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG os_vif [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:64:12,bridge_name='br-int',has_traffic_filtering=True,id=97b9bcbd-4448-4211-a3df-f3e08a41f14e,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b9bcbd-44') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97b9bcbd-44, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:11 user nova-compute[72178]: INFO os_vif [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:64:12,bridge_name='br-int',has_traffic_filtering=True,id=97b9bcbd-4448-4211-a3df-f3e08a41f14e,network=Network(413ea4a6-8bff-40c7-ae4d-3bc119977885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97b9bcbd-44')
Aug 01 12:05:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Deleting instance files /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b_del
Aug 01 12:05:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Deletion of /opt/stack/data/nova/instances/686d22d8-fae6-4035-aeac-c80cbeaff08b_del complete
Aug 01 12:05:12 user nova-compute[72178]: INFO nova.compute.manager [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 01 12:05:12 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:05:12 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:05:12 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:05:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:05:13 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Took 1.02 seconds to deallocate network for instance.
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-60eea65f-06ef-4404-b63b-afdc1b3012c8 req-87e485e3-7b3b-451c-9100-aa4b6b06b9fb service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received event network-vif-deleted-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:13 user nova-compute[72178]: INFO nova.compute.manager [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Detaching volume 21d59707-274c-4ee8-9683-59ccd60abb09
Aug 01 12:05:13 user nova-compute[72178]: INFO nova.virt.block_device [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Attempting to driver detach volume 21d59707-274c-4ee8-9683-59ccd60abb09 from mountpoint /dev/vdb
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Attempting to detach device vdb from instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:05:13 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:05:13 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:05:13 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:05:13 user nova-compute[72178]:   <serial>21d59707-274c-4ee8-9683-59ccd60abb09</serial>
Aug 01 12:05:13 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:05:13 user nova-compute[72178]: </disk>
Aug 01 12:05:13 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:05:13 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Successfully detached device vdb from instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d from the persistent domain config.
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:05:13 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:05:13 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:05:13 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:05:13 user nova-compute[72178]:   <serial>21d59707-274c-4ee8-9683-59ccd60abb09</serial>
Aug 01 12:05:13 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:05:13 user nova-compute[72178]: </disk>
Aug 01 12:05:13 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:13 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Deleted allocations for instance 686d22d8-fae6-4035-aeac-c80cbeaff08b
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-8c726ddf-1f81-41ed-baed-460126f8abcf req-15281a6f-96e3-44b5-ae5a-bbc27c1f1f75 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received event network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8c726ddf-1f81-41ed-baed-460126f8abcf req-15281a6f-96e3-44b5-ae5a-bbc27c1f1f75 service nova] Acquiring lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8c726ddf-1f81-41ed-baed-460126f8abcf req-15281a6f-96e3-44b5-ae5a-bbc27c1f1f75 service nova] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8c726ddf-1f81-41ed-baed-460126f8abcf req-15281a6f-96e3-44b5-ae5a-bbc27c1f1f75 service nova] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-8c726ddf-1f81-41ed-baed-460126f8abcf req-15281a6f-96e3-44b5-ae5a-bbc27c1f1f75 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] No waiting events found dispatching network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:13 user nova-compute[72178]: WARNING nova.compute.manager [req-8c726ddf-1f81-41ed-baed-460126f8abcf req-15281a6f-96e3-44b5-ae5a-bbc27c1f1f75 service nova] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Received unexpected event network-vif-plugged-97b9bcbd-4448-4211-a3df-f3e08a41f14e for instance with vm_state deleted and task_state None.
Aug 01 12:05:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3c7e65b0-7549-4d84-b53e-07035b686f9e tempest-VolumesAdminNegativeTest-1802258801 tempest-VolumesAdminNegativeTest-1802258801-project-member] Lock "686d22d8-fae6-4035-aeac-c80cbeaff08b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891514.0461586, 96c961db-b50d-45c9-bc4f-0c594b5a6c2d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:05:14 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Successfully detached device vdb from instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d from the live domain config.
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zJUDTwPl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:05:14 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0c80fb-4791-4303-ba07-2afa804d7d65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2072d22-6899-438b-9b85-68f00386fda8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:05:14 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:05:14 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:05:14 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:05:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:05:14 user nova-compute[72178]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 (non-flash)
Aug 01 12:05:14 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:05:14 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:05:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f421e7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aa32ad-9e45-4eb1-9f57-476052da2a82]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[09020586-0e1c-465f-9cfc-e7b77904ec9a]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59971fa-713d-455b-90bf-c941005ae0c7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a95d502-5a89-4df3-a0ff-97b8602b9ae7]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f581b9f-0a34-4f37-b536-621fee282e58]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0892f1-8222-46ef-a9e7-5bf759a5ff79]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09, portal: 172.16.0.220,3260]
Aug 01 12:05:14 user nova-compute[72178]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09, portal: 172.16.0.220,3260] successful.
Aug 01 12:05:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21d59707-274c-4ee8-9683-59ccd60abb09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a617ed6-7543-4b6d-bc82-4687416d195d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] <== disconnect_volume: return (327ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_power_states {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 5f720460-477f-472a-904b-7a8c82bca76e {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid f4ae1965-8660-4deb-8427-cafa57f837c8 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "5f720460-477f-472a-904b-7a8c82bca76e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "f4ae1965-8660-4deb-8427-cafa57f837c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "5f720460-477f-472a-904b-7a8c82bca76e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:15 user nova-compute[72178]: DEBUG nova.objects.instance [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'flavor' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-33ac918a-9c1e-41ab-981d-95e5428cbebe tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.999s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.870s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:17 user nova-compute[72178]: INFO nova.compute.manager [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Terminating instance
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-855b384c-604e-4c22-9707-c912f90cc84c req-3ea715d3-df13-430c-ba9d-003afb7938b6 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-unplugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-855b384c-604e-4c22-9707-c912f90cc84c req-3ea715d3-df13-430c-ba9d-003afb7938b6 service nova] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-855b384c-604e-4c22-9707-c912f90cc84c req-3ea715d3-df13-430c-ba9d-003afb7938b6 service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-855b384c-604e-4c22-9707-c912f90cc84c req-3ea715d3-df13-430c-ba9d-003afb7938b6 service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-855b384c-604e-4c22-9707-c912f90cc84c req-3ea715d3-df13-430c-ba9d-003afb7938b6 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] No waiting events found dispatching network-vif-unplugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-855b384c-604e-4c22-9707-c912f90cc84c req-3ea715d3-df13-430c-ba9d-003afb7938b6 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-unplugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Instance destroyed successfully.
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'resources' on Instance uuid a378bfa5-d230-4e81-bc4f-16132501f1df {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1036967952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1036967952',id=1,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/k0AF0iCovyXTACa5eh3dd6pxRNW/SUFtSHtOjmemB5IfF7kyYOtdWAYj/Gd497SIk8ZXd8uhZGLK6NnghFD57HW695kxmzHbA12mCcmXuNymqYCZmag/37hQCZWCzcA==',key_name='tempest-keypair-644047153',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-n6me8y70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=a378bfa5-d230-4e81-bc4f-16132501f1df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "address": "fa:16:3e:79:57:f2", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d72fdf-80", "ovs_interfaceid": "c3d72fdf-8035-4c64-8514-366e8e6b2b51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG os_vif [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d72fdf-80, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:05:17 user nova-compute[72178]: INFO os_vif [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:57:f2,bridge_name='br-int',has_traffic_filtering=True,id=c3d72fdf-8035-4c64-8514-366e8e6b2b51,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d72fdf-80')
Aug 01 12:05:17 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Deleting instance files /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df_del
Aug 01 12:05:17 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Deletion of /opt/stack/data/nova/instances/a378bfa5-d230-4e81-bc4f-16132501f1df_del complete
Aug 01 12:05:17 user nova-compute[72178]: INFO nova.compute.manager [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 01 12:05:17 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:05:17 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:05:18 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:05:18 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Took 1.01 seconds to deallocate network for instance.
Aug 01 12:05:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-c6d44aca-f0d2-498f-8ca7-4b7400baaa2a req-bf14631b-bc16-4494-b4d9-68a563f6a9f8 service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-deleted-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:19 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Deleted allocations for instance a378bfa5-d230-4e81-bc4f-16132501f1df
Aug 01 12:05:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-6fd7e734-4540-4b7c-8b80-fba51d8c3fc7 req-00e8969d-2ad6-4dd7-ad2c-986594109c8e service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6fd7e734-4540-4b7c-8b80-fba51d8c3fc7 req-00e8969d-2ad6-4dd7-ad2c-986594109c8e service nova] Acquiring lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6fd7e734-4540-4b7c-8b80-fba51d8c3fc7 req-00e8969d-2ad6-4dd7-ad2c-986594109c8e service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6fd7e734-4540-4b7c-8b80-fba51d8c3fc7 req-00e8969d-2ad6-4dd7-ad2c-986594109c8e service nova] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-6fd7e734-4540-4b7c-8b80-fba51d8c3fc7 req-00e8969d-2ad6-4dd7-ad2c-986594109c8e service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] No waiting events found dispatching network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:19 user nova-compute[72178]: WARNING nova.compute.manager [req-6fd7e734-4540-4b7c-8b80-fba51d8c3fc7 req-00e8969d-2ad6-4dd7-ad2c-986594109c8e service nova] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Received unexpected event network-vif-plugged-c3d72fdf-8035-4c64-8514-366e8e6b2b51 for instance with vm_state deleted and task_state None.
Aug 01 12:05:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-17af56e2-4d26-4c6b-811f-6c13ec7de5cd tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "a378bfa5-d230-4e81-bc4f-16132501f1df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.535s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:26 user nova-compute[72178]: INFO nova.compute.manager [None req-fb0cd961-0648-4c35-9c51-ae60595030ba tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Unrescuing
Aug 01 12:05:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fb0cd961-0648-4c35-9c51-ae60595030ba tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:05:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fb0cd961-0648-4c35-9c51-ae60595030ba tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquired lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:05:26 user nova-compute[72178]: DEBUG nova.network.neutron [None req-fb0cd961-0648-4c35-9c51-ae60595030ba tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:05:26 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891511.8325555, 686d22d8-fae6-4035-aeac-c80cbeaff08b => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:26 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] VM Stopped (Lifecycle Event)
Aug 01 12:05:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a072cb85-b6e9-4d6a-8854-d7987323bf53 None None] [instance: 686d22d8-fae6-4035-aeac-c80cbeaff08b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:26 user nova-compute[72178]: DEBUG nova.network.neutron [None req-fb0cd961-0648-4c35-9c51-ae60595030ba tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updating instance_info_cache with network_info: [{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:05:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fb0cd961-0648-4c35-9c51-ae60595030ba tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Releasing lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:05:26 user nova-compute[72178]: DEBUG nova.objects.instance [None req-fb0cd961-0648-4c35-9c51-ae60595030ba tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'flavor' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-6a7cba7d-014d-4f79-b530-8adfcd32fde5 req-bb7da9b2-c5fd-4570-b2d8-4086218be701 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6a7cba7d-014d-4f79-b530-8adfcd32fde5 req-bb7da9b2-c5fd-4570-b2d8-4086218be701 service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6a7cba7d-014d-4f79-b530-8adfcd32fde5 req-bb7da9b2-c5fd-4570-b2d8-4086218be701 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6a7cba7d-014d-4f79-b530-8adfcd32fde5 req-bb7da9b2-c5fd-4570-b2d8-4086218be701 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-6a7cba7d-014d-4f79-b530-8adfcd32fde5 req-bb7da9b2-c5fd-4570-b2d8-4086218be701 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:27 user nova-compute[72178]: WARNING nova.compute.manager [req-6a7cba7d-014d-4f79-b530-8adfcd32fde5 req-bb7da9b2-c5fd-4570-b2d8-4086218be701 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:05:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance destroyed successfully.
Aug 01 12:05:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:28 user nova-compute[72178]: INFO nova.compute.manager [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Terminating instance
Aug 01 12:05:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Instance destroyed successfully.
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.objects.instance [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lazy-loading 'resources' on Instance uuid a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1539614270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1539614270',id=16,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3l0CrAp4blgm8p6J/CpMMmsynu7w4Q6ggCy2BAEuQiOvazPWA7Q9HgfC4YOhoX00X2/4A1muPlL6MCNEVU526AcZQkLN/mo9CJfWbPp2gR5FdDgha9mZBUuswKBX7xCA==',key_name='tempest-keypair-591392986',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:02:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a22155938fca465f904a75e3d0a1bd56',ramdisk_id='',reservation_id='r-yze31y42',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1431933072',owner_user_name='tempest-TaggedAttachmentsTest-1431933072-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7a73caf203ad4e8aaac7a1efb956c048',uuid=a42c3ebd-74a5-4745-a2a8-ade6b5636dc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converting VIF {"id": "1c228670-844c-44a4-ad61-a9982fe910fd", "address": "fa:16:3e:66:5f:25", "network": {"id": "d4061bdf-5724-49cb-9b82-a5230c0a6663", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1318529546-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a22155938fca465f904a75e3d0a1bd56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c228670-84", "ovs_interfaceid": "1c228670-844c-44a4-ad61-a9982fe910fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:5f:25,bridge_name='br-int',has_traffic_filtering=True,id=1c228670-844c-44a4-ad61-a9982fe910fd,network=Network(d4061bdf-5724-49cb-9b82-a5230c0a6663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c228670-84') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG os_vif [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:5f:25,bridge_name='br-int',has_traffic_filtering=True,id=1c228670-844c-44a4-ad61-a9982fe910fd,network=Network(d4061bdf-5724-49cb-9b82-a5230c0a6663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c228670-84') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c228670-84, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: INFO os_vif [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:5f:25,bridge_name='br-int',has_traffic_filtering=True,id=1c228670-844c-44a4-ad61-a9982fe910fd,network=Network(d4061bdf-5724-49cb-9b82-a5230c0a6663),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c228670-84')
Aug 01 12:05:29 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Deleting instance files /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4_del
Aug 01 12:05:29 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Deletion of /opt/stack/data/nova/instances/a42c3ebd-74a5-4745-a2a8-ade6b5636dc4_del complete
Aug 01 12:05:29 user nova-compute[72178]: INFO nova.compute.manager [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:29 user nova-compute[72178]: WARNING nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-unplugged-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] No waiting events found dispatching network-vif-unplugged-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-unplugged-1c228670-844c-44a4-ad61-a9982fe910fd for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Acquiring lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] No waiting events found dispatching network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:29 user nova-compute[72178]: WARNING nova.compute.manager [req-b96e9430-7fb1-44be-96ed-8b5f4b00f9c7 req-922477e7-7294-41f7-923a-0e28eb7f2771 service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received unexpected event network-vif-plugged-1c228670-844c-44a4-ad61-a9982fe910fd for instance with vm_state active and task_state deleting.
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-8ff31e1d-d91e-490e-943d-ae30fc79a012 req-9923319d-c897-43ba-a591-b6ccb97801ee service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Received event network-vif-deleted-1c228670-844c-44a4-ad61-a9982fe910fd {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:30 user nova-compute[72178]: INFO nova.compute.manager [req-8ff31e1d-d91e-490e-943d-ae30fc79a012 req-9923319d-c897-43ba-a591-b6ccb97801ee service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Neutron deleted interface 1c228670-844c-44a4-ad61-a9982fe910fd; detaching it from the instance and deleting it from the info cache
Aug 01 12:05:30 user nova-compute[72178]: DEBUG nova.network.neutron [req-8ff31e1d-d91e-490e-943d-ae30fc79a012 req-9923319d-c897-43ba-a591-b6ccb97801ee service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:05:30 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Took 1.33 seconds to deallocate network for instance.
Aug 01 12:05:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-8ff31e1d-d91e-490e-943d-ae30fc79a012 req-9923319d-c897-43ba-a591-b6ccb97801ee service nova] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Detach interface failed, port_id=1c228670-844c-44a4-ad61-a9982fe910fd, reason: Instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.581s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:31 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Deleted allocations for instance a42c3ebd-74a5-4745-a2a8-ade6b5636dc4
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fb0cd961-0648-4c35-9c51-ae60595030ba tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for 8ac32412-1f05-4d62-a184-0b90f1b3d21c due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891531.4113367, 8ac32412-1f05-4d62-a184-0b90f1b3d21c => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] VM Resumed (Lifecycle Event)
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ced42395-29f8-4d7a-904f-fcde26476303 tempest-TaggedAttachmentsTest-1431933072 tempest-TaggedAttachmentsTest-1431933072-project-member] Lock "a42c3ebd-74a5-4745-a2a8-ade6b5636dc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.429s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:31 user nova-compute[72178]: WARNING nova.compute.manager [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:31 user nova-compute[72178]: WARNING nova.compute.manager [req-ee0e17c5-a00a-4626-92c8-5b744200b878 req-5c9cd3f7-a845-47b3-b829-eeaae4246043 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:05:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891531.4126487, 8ac32412-1f05-4d62-a184-0b90f1b3d21c => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] VM Started (Lifecycle Event)
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:32 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891517.8421388, a378bfa5-d230-4e81-bc4f-16132501f1df => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:32 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] VM Stopped (Lifecycle Event)
Aug 01 12:05:32 user nova-compute[72178]: DEBUG nova.compute.manager [None req-54721623-579a-469c-a58f-4a05f55b4fa2 None None] [instance: a378bfa5-d230-4e81-bc4f-16132501f1df] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:33 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:05:33 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7258MB free_disk=25.331668853759766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f4ae1965-8660-4deb-8427-cafa57f837c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:05:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:34 user nova-compute[72178]: INFO nova.compute.manager [None req-a29b90c4-e1cc-4d14-9d29-8dc423d65095 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Unrescuing
Aug 01 12:05:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a29b90c4-e1cc-4d14-9d29-8dc423d65095 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:05:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a29b90c4-e1cc-4d14-9d29-8dc423d65095 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquired lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:05:34 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a29b90c4-e1cc-4d14-9d29-8dc423d65095 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:05:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a29b90c4-e1cc-4d14-9d29-8dc423d65095 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updating instance_info_cache with network_info: [{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a29b90c4-e1cc-4d14-9d29-8dc423d65095 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Releasing lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a29b90c4-e1cc-4d14-9d29-8dc423d65095 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'flavor' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [{"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-f75a07e7-7cd8-4a63-b03d-422e07da25f8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-5380dd2a-6855-4377-bde3-3e56579c3cae req-fe8cfb34-37ba-4786-8661-3f3fd3df73e2 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5380dd2a-6855-4377-bde3-3e56579c3cae req-fe8cfb34-37ba-4786-8661-3f3fd3df73e2 service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5380dd2a-6855-4377-bde3-3e56579c3cae req-fe8cfb34-37ba-4786-8661-3f3fd3df73e2 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5380dd2a-6855-4377-bde3-3e56579c3cae req-fe8cfb34-37ba-4786-8661-3f3fd3df73e2 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-5380dd2a-6855-4377-bde3-3e56579c3cae req-fe8cfb34-37ba-4786-8661-3f3fd3df73e2 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:35 user nova-compute[72178]: WARNING nova.compute.manager [req-5380dd2a-6855-4377-bde3-3e56579c3cae req-fe8cfb34-37ba-4786-8661-3f3fd3df73e2 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:05:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance destroyed successfully.
Aug 01 12:05:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-bede3fdd-d67f-46a8-8f92-916aca332500 req-e3cf6802-33dd-47c1-bb6d-54c306f1a653 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bede3fdd-d67f-46a8-8f92-916aca332500 req-e3cf6802-33dd-47c1-bb6d-54c306f1a653 service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bede3fdd-d67f-46a8-8f92-916aca332500 req-e3cf6802-33dd-47c1-bb6d-54c306f1a653 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bede3fdd-d67f-46a8-8f92-916aca332500 req-e3cf6802-33dd-47c1-bb6d-54c306f1a653 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-bede3fdd-d67f-46a8-8f92-916aca332500 req-e3cf6802-33dd-47c1-bb6d-54c306f1a653 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:37 user nova-compute[72178]: WARNING nova.compute.manager [req-bede3fdd-d67f-46a8-8f92-916aca332500 req-e3cf6802-33dd-47c1-bb6d-54c306f1a653 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:05:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:40 user nova-compute[72178]: WARNING nova.compute.manager [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:40 user nova-compute[72178]: WARNING nova.compute.manager [req-1232740d-c801-4e48-9b50-b33739f8aa09 req-1c883bba-e087-4ed1-bede-d3f0c292f0e3 service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for d3870f4a-ea47-4075-b342-2b20cfa749f9 due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891540.1265588, d3870f4a-ea47-4075-b342-2b20cfa749f9 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] VM Resumed (Lifecycle Event)
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a29b90c4-e1cc-4d14-9d29-8dc423d65095 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:05:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891540.1276977, d3870f4a-ea47-4075-b342-2b20cfa749f9 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] VM Started (Lifecycle Event)
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:05:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:43 user nova-compute[72178]: INFO nova.compute.manager [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Detaching volume b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a
Aug 01 12:05:43 user nova-compute[72178]: INFO nova.virt.block_device [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Attempting to driver detach volume b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a from mountpoint /dev/vdb
Aug 01 12:05:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Attempting to detach device vdb from instance 84869969-6058-4000-808e-7ccb4ea10aa9 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:05:43 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:05:43 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:05:43 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:05:43 user nova-compute[72178]:   <serial>b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a</serial>
Aug 01 12:05:43 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 12:05:43 user nova-compute[72178]: </disk>
Aug 01 12:05:43 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:05:43 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully detached device vdb from instance 84869969-6058-4000-808e-7ccb4ea10aa9 from the persistent domain config.
Aug 01 12:05:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 84869969-6058-4000-808e-7ccb4ea10aa9 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:05:43 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:05:43 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:05:43 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:05:43 user nova-compute[72178]:   <serial>b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a</serial>
Aug 01 12:05:43 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 12:05:43 user nova-compute[72178]: </disk>
Aug 01 12:05:43 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891543.61287, 84869969-6058-4000-808e-7ccb4ea10aa9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:05:43 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully detached device vdb from instance 84869969-6058-4000-808e-7ccb4ea10aa9 from the live domain config.
Aug 01 12:05:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbzIyFTh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:05:43 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67e0b3a-0c4f-4d7e-96d6-cc56e11ae4e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c349e7ab-068e-4a70-b9c6-86118f859aba]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:05:43 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:05:43 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:05:43 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:05:43 user nova-compute[72178]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a (non-flash)
Aug 01 12:05:43 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:05:43 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f440f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea8581-aa45-4311-9123-926d425c348e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a87ec-0cab-4b94-836b-b404862b0451]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd93f9ed-3c58-4bf5-8075-c23ee0a36d43]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b0ac22-9078-4459-b3f5-332be05209ef]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c554ad2d-4521-446c-b9fb-81cc60f90c2f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[091e5908-9921-4d6c-ad97-8554a0069f0f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260]
Aug 01 12:05:43 user nova-compute[72178]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a, portal: 172.16.0.220,3260] successful.
Aug 01 12:05:43 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b59ea341-f4bb-4e1f-8cd1-9c12fd87b00a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5991aebc-4ba2-4b8b-9ad7-67c1e8dbe2c8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== disconnect_volume: return (278ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:05:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:05:44 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891529.1093516, a42c3ebd-74a5-4745-a2a8-ade6b5636dc4 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:05:44 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] VM Stopped (Lifecycle Event)
Aug 01 12:05:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ece55186-642a-43ea-8bf1-5bcc48dc14ec None None] [instance: a42c3ebd-74a5-4745-a2a8-ade6b5636dc4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:05:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:44 user nova-compute[72178]: DEBUG nova.objects.instance [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'flavor' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-932f72f7-a6d4-4e5e-8584-0d8394978a62 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.559s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:54 user nova-compute[72178]: INFO nova.compute.manager [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Terminating instance
Aug 01 12:05:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-fff8e9e6-417c-4918-b0af-e224c815d0c6 req-71310767-9cf5-4048-ab39-b0365dc41c3d service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received event network-vif-unplugged-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fff8e9e6-417c-4918-b0af-e224c815d0c6 req-71310767-9cf5-4048-ab39-b0365dc41c3d service nova] Acquiring lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fff8e9e6-417c-4918-b0af-e224c815d0c6 req-71310767-9cf5-4048-ab39-b0365dc41c3d service nova] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fff8e9e6-417c-4918-b0af-e224c815d0c6 req-71310767-9cf5-4048-ab39-b0365dc41c3d service nova] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-fff8e9e6-417c-4918-b0af-e224c815d0c6 req-71310767-9cf5-4048-ab39-b0365dc41c3d service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] No waiting events found dispatching network-vif-unplugged-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-fff8e9e6-417c-4918-b0af-e224c815d0c6 req-71310767-9cf5-4048-ab39-b0365dc41c3d service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received event network-vif-unplugged-128a1401-bebc-4ef9-9365-14076992ab8a for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:05:55 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Instance destroyed successfully.
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.objects.instance [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lazy-loading 'resources' on Instance uuid 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-619255797',display_name='tempest-VolumesNegativeTest-instance-619255797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-619255797',id=17,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:04:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff9be9ff999d442a90932dedb57de9df',ramdisk_id='',reservation_id='r-p839t0i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1457193251',owner_user_name='tempest-VolumesNegativeTest-1457193251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:04:13Z,user_data=None,user_id='d2d25ebda28942faad0e95c91d565732',uuid=1c29d606-c2ab-46ab-8f35-8f9a0de5fb57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Converting VIF {"id": "128a1401-bebc-4ef9-9365-14076992ab8a", "address": "fa:16:3e:2e:a5:ff", "network": {"id": "e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "385d17d010204e7b81c7f663adf8b18a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap128a1401-be", "ovs_interfaceid": "128a1401-bebc-4ef9-9365-14076992ab8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a5:ff,bridge_name='br-int',has_traffic_filtering=True,id=128a1401-bebc-4ef9-9365-14076992ab8a,network=Network(e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128a1401-be') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG os_vif [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a5:ff,bridge_name='br-int',has_traffic_filtering=True,id=128a1401-bebc-4ef9-9365-14076992ab8a,network=Network(e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128a1401-be') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap128a1401-be, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:05:55 user nova-compute[72178]: INFO os_vif [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a5:ff,bridge_name='br-int',has_traffic_filtering=True,id=128a1401-bebc-4ef9-9365-14076992ab8a,network=Network(e3dc69e0-8de3-4f52-85bc-3dbf26a3fe60),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap128a1401-be')
Aug 01 12:05:55 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Deleting instance files /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57_del
Aug 01 12:05:55 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Deletion of /opt/stack/data/nova/instances/1c29d606-c2ab-46ab-8f35-8f9a0de5fb57_del complete
Aug 01 12:05:55 user nova-compute[72178]: INFO nova.compute.manager [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 12:05:55 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:05:55 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:05:56 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:05:56 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Took 0.45 seconds to deallocate network for instance.
Aug 01 12:05:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:56 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:05:56 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:05:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:56 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Deleted allocations for instance 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57
Aug 01 12:05:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-48665119-0a8b-44f8-941b-db4a8d013b79 tempest-VolumesNegativeTest-1457193251 tempest-VolumesNegativeTest-1457193251-project-member] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.760s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-f0d78271-043c-4932-8883-de1f6e9f43f2 req-d1e603b9-1de8-4a96-a63d-98e3871f4e48 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received event network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f0d78271-043c-4932-8883-de1f6e9f43f2 req-d1e603b9-1de8-4a96-a63d-98e3871f4e48 service nova] Acquiring lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:05:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f0d78271-043c-4932-8883-de1f6e9f43f2 req-d1e603b9-1de8-4a96-a63d-98e3871f4e48 service nova] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:05:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f0d78271-043c-4932-8883-de1f6e9f43f2 req-d1e603b9-1de8-4a96-a63d-98e3871f4e48 service nova] Lock "1c29d606-c2ab-46ab-8f35-8f9a0de5fb57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:05:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-f0d78271-043c-4932-8883-de1f6e9f43f2 req-d1e603b9-1de8-4a96-a63d-98e3871f4e48 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] No waiting events found dispatching network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:05:57 user nova-compute[72178]: WARNING nova.compute.manager [req-f0d78271-043c-4932-8883-de1f6e9f43f2 req-d1e603b9-1de8-4a96-a63d-98e3871f4e48 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received unexpected event network-vif-plugged-128a1401-bebc-4ef9-9365-14076992ab8a for instance with vm_state deleted and task_state None.
Aug 01 12:05:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-f0d78271-043c-4932-8883-de1f6e9f43f2 req-d1e603b9-1de8-4a96-a63d-98e3871f4e48 service nova] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Received event network-vif-deleted-128a1401-bebc-4ef9-9365-14076992ab8a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:05:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:04 user nova-compute[72178]: INFO nova.compute.manager [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Terminating instance
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-b64fd955-63bf-498c-96f7-5a264a2221d1 req-24424948-057a-4d66-89e2-fc4aeb2b1c0a service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received event network-changed-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-b64fd955-63bf-498c-96f7-5a264a2221d1 req-24424948-057a-4d66-89e2-fc4aeb2b1c0a service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Refreshing instance network info cache due to event network-changed-ce1a144e-d9df-4bb3-846d-7e0ebffd4373. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b64fd955-63bf-498c-96f7-5a264a2221d1 req-24424948-057a-4d66-89e2-fc4aeb2b1c0a service nova] Acquiring lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b64fd955-63bf-498c-96f7-5a264a2221d1 req-24424948-057a-4d66-89e2-fc4aeb2b1c0a service nova] Acquired lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.network.neutron [req-b64fd955-63bf-498c-96f7-5a264a2221d1 req-24424948-057a-4d66-89e2-fc4aeb2b1c0a service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Refreshing network info cache for port ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-2c0ed142-b8ef-4a92-a6cf-511ad3e6cf0d req-1d06ded2-7f70-4c41-b891-09218f03b99a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2c0ed142-b8ef-4a92-a6cf-511ad3e6cf0d req-1d06ded2-7f70-4c41-b891-09218f03b99a service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2c0ed142-b8ef-4a92-a6cf-511ad3e6cf0d req-1d06ded2-7f70-4c41-b891-09218f03b99a service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2c0ed142-b8ef-4a92-a6cf-511ad3e6cf0d req-1d06ded2-7f70-4c41-b891-09218f03b99a service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-2c0ed142-b8ef-4a92-a6cf-511ad3e6cf0d req-1d06ded2-7f70-4c41-b891-09218f03b99a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-2c0ed142-b8ef-4a92-a6cf-511ad3e6cf0d req-1d06ded2-7f70-4c41-b891-09218f03b99a service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-unplugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:06:04 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Instance destroyed successfully.
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lazy-loading 'resources' on Instance uuid 96c961db-b50d-45c9-bc4f-0c594b5a6c2d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1310442517',display_name='tempest-ServerStableDeviceRescueTest-server-1310442517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1310442517',id=7,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsBmHVnO/9EUTsKC74RMmVO5u+R3m1s7kZbSPz1nI6lkEfrYK4U04WdlnuQWv7muLheKRhVUhUIGufzpGOsl6lv4anSTSZ1rccfsHs4SgBPjx6GjZKQbeEO3plhLWQDiQ==',key_name='tempest-keypair-769995709',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:02:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8cafcb07520f4031a1902defc1d5a5e0',ramdisk_id='',reservation_id='r-k2jg8hq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-970062569',owner_user_name='tempest-ServerStableDeviceRescueTest-970062569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='822801b8c40b40b1a49fbdd859575f1a',uuid=96c961db-b50d-45c9-bc4f-0c594b5a6c2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Converting VIF {"id": "af72e448-83b0-4bec-8ead-79148cc4213c", "address": "fa:16:3e:01:b8:ea", "network": {"id": "1d9d7786-4cab-410a-a318-cb21f3870443", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1903401655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8cafcb07520f4031a1902defc1d5a5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf72e448-83", "ovs_interfaceid": "af72e448-83b0-4bec-8ead-79148cc4213c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:b8:ea,bridge_name='br-int',has_traffic_filtering=True,id=af72e448-83b0-4bec-8ead-79148cc4213c,network=Network(1d9d7786-4cab-410a-a318-cb21f3870443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf72e448-83') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG os_vif [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:b8:ea,bridge_name='br-int',has_traffic_filtering=True,id=af72e448-83b0-4bec-8ead-79148cc4213c,network=Network(1d9d7786-4cab-410a-a318-cb21f3870443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf72e448-83') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf72e448-83, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:06:04 user nova-compute[72178]: INFO os_vif [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:b8:ea,bridge_name='br-int',has_traffic_filtering=True,id=af72e448-83b0-4bec-8ead-79148cc4213c,network=Network(1d9d7786-4cab-410a-a318-cb21f3870443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf72e448-83')
Aug 01 12:06:04 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Deleting instance files /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d_del
Aug 01 12:06:04 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Deletion of /opt/stack/data/nova/instances/96c961db-b50d-45c9-bc4f-0c594b5a6c2d_del complete
Aug 01 12:06:04 user nova-compute[72178]: INFO nova.compute.manager [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 12:06:04 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:06:04 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:06:05 user nova-compute[72178]: DEBUG nova.network.neutron [req-b64fd955-63bf-498c-96f7-5a264a2221d1 req-24424948-057a-4d66-89e2-fc4aeb2b1c0a service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Updated VIF entry in instance network info cache for port ce1a144e-d9df-4bb3-846d-7e0ebffd4373. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:06:05 user nova-compute[72178]: DEBUG nova.network.neutron [req-b64fd955-63bf-498c-96f7-5a264a2221d1 req-24424948-057a-4d66-89e2-fc4aeb2b1c0a service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Updating instance_info_cache with network_info: [{"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:06:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b64fd955-63bf-498c-96f7-5a264a2221d1 req-24424948-057a-4d66-89e2-fc4aeb2b1c0a service nova] Releasing lock "refresh_cache-f4ae1965-8660-4deb-8427-cafa57f837c8" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:06:06 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Took 1.08 seconds to deallocate network for instance.
Aug 01 12:06:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-0a231f97-0342-4926-83d0-4cfbf10d65c0 req-4aada503-6d1e-45b3-8051-2052ca57b4db service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-deleted-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:06 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Deleted allocations for instance 96c961db-b50d-45c9-bc4f-0c594b5a6c2d
Aug 01 12:06:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a25b7782-789b-4e15-aaf3-626f4e6c543d tempest-ServerStableDeviceRescueTest-970062569 tempest-ServerStableDeviceRescueTest-970062569-project-member] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.485s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-79aff29e-0f60-4e8a-894c-0c6b95582333 req-53f375b2-10ec-44b7-b705-b3eeb6471d78 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-79aff29e-0f60-4e8a-894c-0c6b95582333 req-53f375b2-10ec-44b7-b705-b3eeb6471d78 service nova] Acquiring lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-79aff29e-0f60-4e8a-894c-0c6b95582333 req-53f375b2-10ec-44b7-b705-b3eeb6471d78 service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-79aff29e-0f60-4e8a-894c-0c6b95582333 req-53f375b2-10ec-44b7-b705-b3eeb6471d78 service nova] Lock "96c961db-b50d-45c9-bc4f-0c594b5a6c2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-79aff29e-0f60-4e8a-894c-0c6b95582333 req-53f375b2-10ec-44b7-b705-b3eeb6471d78 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] No waiting events found dispatching network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:06:06 user nova-compute[72178]: WARNING nova.compute.manager [req-79aff29e-0f60-4e8a-894c-0c6b95582333 req-53f375b2-10ec-44b7-b705-b3eeb6471d78 service nova] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Received unexpected event network-vif-plugged-af72e448-83b0-4bec-8ead-79148cc4213c for instance with vm_state deleted and task_state None.
Aug 01 12:06:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:10 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891555.5775435, 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:06:10 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] VM Stopped (Lifecycle Event)
Aug 01 12:06:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-771ac54d-de0e-404e-925e-791970010180 None None] [instance: 1c29d606-c2ab-46ab-8f35-8f9a0de5fb57] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:06:13 user nova-compute[72178]: INFO nova.compute.claims [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Claim successful on node user
Aug 01 12:06:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:06:13 user nova-compute[72178]: DEBUG nova.network.neutron [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:06:13 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:06:13 user nova-compute[72178]: DEBUG nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG nova.policy [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '435396a1a5f54338a2af729f1e3f1754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41cc7b29110b4871a9b5c6e0328bdd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:06:14 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Creating image(s)
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk 1073741824" returned: 0 in 0.050s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Cannot resize image /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG nova.objects.instance [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'migration_context' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Ensure instance console log exists: /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG nova.network.neutron [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Successfully created port: e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:06:15 user nova-compute[72178]: INFO nova.compute.claims [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Claim successful on node user
Aug 01 12:06:15 user nova-compute[72178]: DEBUG nova.network.neutron [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Successfully updated port: e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquired lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG nova.network.neutron [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-096bf713-c912-47dc-a7ad-cabaf61aba5f req-271e70c1-f9d7-4f3a-a18c-e567e93dd165 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-changed-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-096bf713-c912-47dc-a7ad-cabaf61aba5f req-271e70c1-f9d7-4f3a-a18c-e567e93dd165 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Refreshing instance network info cache due to event network-changed-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:06:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-096bf713-c912-47dc-a7ad-cabaf61aba5f req-271e70c1-f9d7-4f3a-a18c-e567e93dd165 service nova] Acquiring lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:06:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:06:16 user nova-compute[72178]: INFO nova.virt.block_device [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Booting with volume e6622ae6-bbb1-420e-a2f7-89085dfb1a6f at /dev/vda
Aug 01 12:06:16 user nova-compute[72178]: DEBUG os_brick.utils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b2f860-2b08-4e39-b33f-e266740a2c9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4219957-5bf6-43ae-a0da-20e612c2b0b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.policy [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '551db946d0e94b50af2c5c659f4c82ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ee13aa6423e4d33bfe59e2a092a5578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0970cd5-7fe5-4a57-af57-855c778c6db6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[764ad664-20af-4de9-996e-7c5c630ea964]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:06:16 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeaff3c-6cc8-43c1-9685-3c617383f931]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG os_brick.utils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Updating existing volume attachment record: db7679d4-67f3-4fe2-beff-b18d318cae15 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updating instance_info_cache with network_info: [{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Releasing lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance network_info: |[{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-096bf713-c912-47dc-a7ad-cabaf61aba5f req-271e70c1-f9d7-4f3a-a18c-e567e93dd165 service nova] Acquired lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.network.neutron [req-096bf713-c912-47dc-a7ad-cabaf61aba5f req-271e70c1-f9d7-4f3a-a18c-e567e93dd165 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Refreshing network info cache for port e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Start _get_guest_xml network_info=[{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:06:16 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:06:16 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1643210725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1643210725',id=19,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjAoXiXijaPgStwNb3E/WYuB63IX6EsfgH4MXYEG8WzG9jHBKzAWMRM5Ek/XHyV/s1ms9GKPP/t84r/7Q/M1HuC5cwkUk7L2lfwOVJUxSaSKKBbJtOUJjYdiD1PNY3xDQ==',key_name='tempest-keypair-1918189647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-4l02fltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=6341837b-67ea-42df-b3e9-c58e07857774,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.objects.instance [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'pci_devices' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:06:16 user nova-compute[72178]:   <uuid>6341837b-67ea-42df-b3e9-c58e07857774</uuid>
Aug 01 12:06:16 user nova-compute[72178]:   <name>instance-00000013</name>
Aug 01 12:06:16 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:06:16 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:06:16 user nova-compute[72178]:   <metadata>
Aug 01 12:06:16 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:06:16 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:06:16 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1643210725</nova:name>
Aug 01 12:06:16 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:06:16</nova:creationTime>
Aug 01 12:06:16 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:06:16 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:06:16 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:06:16 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:06:16 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:06:16 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:06:16 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:06:16 user nova-compute[72178]:       <nova:owner>
Aug 01 12:06:16 user nova-compute[72178]:         <nova:user uuid="435396a1a5f54338a2af729f1e3f1754">tempest-AttachVolumeShelveTestJSON-210279899-project-member</nova:user>
Aug 01 12:06:16 user nova-compute[72178]:         <nova:project uuid="41cc7b29110b4871a9b5c6e0328bdd28">tempest-AttachVolumeShelveTestJSON-210279899</nova:project>
Aug 01 12:06:16 user nova-compute[72178]:       </nova:owner>
Aug 01 12:06:16 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:06:16 user nova-compute[72178]:       <nova:ports>
Aug 01 12:06:16 user nova-compute[72178]:         <nova:port uuid="e47ac7c6-ea8c-4491-9e2a-2e227b2a305a">
Aug 01 12:06:16 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 12:06:16 user nova-compute[72178]:         </nova:port>
Aug 01 12:06:16 user nova-compute[72178]:       </nova:ports>
Aug 01 12:06:16 user nova-compute[72178]:     </nova:instance>
Aug 01 12:06:16 user nova-compute[72178]:   </metadata>
Aug 01 12:06:16 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:06:16 user nova-compute[72178]:     <system>
Aug 01 12:06:16 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:06:16 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:06:16 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:06:16 user nova-compute[72178]:       <entry name="serial">6341837b-67ea-42df-b3e9-c58e07857774</entry>
Aug 01 12:06:16 user nova-compute[72178]:       <entry name="uuid">6341837b-67ea-42df-b3e9-c58e07857774</entry>
Aug 01 12:06:16 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:06:16 user nova-compute[72178]:     </system>
Aug 01 12:06:16 user nova-compute[72178]:   </sysinfo>
Aug 01 12:06:16 user nova-compute[72178]:   <os>
Aug 01 12:06:16 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:06:16 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:06:16 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:06:16 user nova-compute[72178]:   </os>
Aug 01 12:06:16 user nova-compute[72178]:   <features>
Aug 01 12:06:16 user nova-compute[72178]:     <acpi/>
Aug 01 12:06:16 user nova-compute[72178]:     <apic/>
Aug 01 12:06:16 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:06:16 user nova-compute[72178]:   </features>
Aug 01 12:06:16 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:06:16 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:06:16 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:06:16 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:06:16 user nova-compute[72178]:   </clock>
Aug 01 12:06:16 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:06:16 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:06:16 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:06:16 user nova-compute[72178]:   </cpu>
Aug 01 12:06:16 user nova-compute[72178]:   <devices>
Aug 01 12:06:16 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:06:16 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:06:16 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk"/>
Aug 01 12:06:16 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:06:16 user nova-compute[72178]:     </disk>
Aug 01 12:06:16 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:06:16 user nova-compute[72178]:       <mac address="fa:16:3e:68:2c:07"/>
Aug 01 12:06:16 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:06:16 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:06:16 user nova-compute[72178]:       <target dev="tape47ac7c6-ea"/>
Aug 01 12:06:16 user nova-compute[72178]:     </interface>
Aug 01 12:06:16 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:06:16 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/console.log" append="off"/>
Aug 01 12:06:16 user nova-compute[72178]:     </serial>
Aug 01 12:06:16 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:06:16 user nova-compute[72178]:     <video>
Aug 01 12:06:16 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:06:16 user nova-compute[72178]:     </video>
Aug 01 12:06:16 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:06:16 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:06:16 user nova-compute[72178]:     </rng>
Aug 01 12:06:16 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:06:16 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:06:16 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:06:16 user nova-compute[72178]:     </memballoon>
Aug 01 12:06:16 user nova-compute[72178]:   </devices>
Aug 01 12:06:16 user nova-compute[72178]: </domain>
Aug 01 12:06:16 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1643210725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1643210725',id=19,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjAoXiXijaPgStwNb3E/WYuB63IX6EsfgH4MXYEG8WzG9jHBKzAWMRM5Ek/XHyV/s1ms9GKPP/t84r/7Q/M1HuC5cwkUk7L2lfwOVJUxSaSKKBbJtOUJjYdiD1PNY3xDQ==',key_name='tempest-keypair-1918189647',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-4l02fltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:06:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=6341837b-67ea-42df-b3e9-c58e07857774,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG os_vif [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape47ac7c6-ea, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape47ac7c6-ea, col_values=(('external_ids', {'iface-id': 'e47ac7c6-ea8c-4491-9e2a-2e227b2a305a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:2c:07', 'vm-uuid': '6341837b-67ea-42df-b3e9-c58e07857774'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:16 user nova-compute[72178]: INFO os_vif [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea')
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:06:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No VIF found with MAC fa:16:3e:68:2c:07, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:06:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-096bf713-c912-47dc-a7ad-cabaf61aba5f req-271e70c1-f9d7-4f3a-a18c-e567e93dd165 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updated VIF entry in instance network info cache for port e47ac7c6-ea8c-4491-9e2a-2e227b2a305a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:06:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-096bf713-c912-47dc-a7ad-cabaf61aba5f req-271e70c1-f9d7-4f3a-a18c-e567e93dd165 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updating instance_info_cache with network_info: [{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:06:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-096bf713-c912-47dc-a7ad-cabaf61aba5f req-271e70c1-f9d7-4f3a-a18c-e567e93dd165 service nova] Releasing lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:06:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Successfully created port: daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:06:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-c591bee7-f5fe-48fa-b17a-246df9c5dd47 req-5f7a6d31-378b-4ff0-a718-ba46bb45771d service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c591bee7-f5fe-48fa-b17a-246df9c5dd47 req-5f7a6d31-378b-4ff0-a718-ba46bb45771d service nova] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c591bee7-f5fe-48fa-b17a-246df9c5dd47 req-5f7a6d31-378b-4ff0-a718-ba46bb45771d service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c591bee7-f5fe-48fa-b17a-246df9c5dd47 req-5f7a6d31-378b-4ff0-a718-ba46bb45771d service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-c591bee7-f5fe-48fa-b17a-246df9c5dd47 req-5f7a6d31-378b-4ff0-a718-ba46bb45771d service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] No waiting events found dispatching network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:06:18 user nova-compute[72178]: WARNING nova.compute.manager [req-c591bee7-f5fe-48fa-b17a-246df9c5dd47 req-5f7a6d31-378b-4ff0-a718-ba46bb45771d service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received unexpected event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a for instance with vm_state building and task_state spawning.
Aug 01 12:06:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG nova.network.neutron [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Successfully updated port: daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquired lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG nova.network.neutron [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-617906c4-c2a6-4212-940e-ed39851665ee req-7b67cd54-cdff-4811-b480-0f5569fcb2d5 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-changed-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-617906c4-c2a6-4212-940e-ed39851665ee req-7b67cd54-cdff-4811-b480-0f5569fcb2d5 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Refreshing instance network info cache due to event network-changed-daf90b1b-c7ac-491e-abf6-4f082775e49e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-617906c4-c2a6-4212-940e-ed39851665ee req-7b67cd54-cdff-4811-b480-0f5569fcb2d5 service nova] Acquiring lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG nova.network.neutron [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:06:19 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891564.8296723, 96c961db-b50d-45c9-bc4f-0c594b5a6c2d => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:06:19 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] VM Stopped (Lifecycle Event)
Aug 01 12:06:19 user nova-compute[72178]: DEBUG nova.compute.manager [None req-882f72c5-8d94-48f6-acc8-666efc490db8 None None] [instance: 96c961db-b50d-45c9-bc4f-0c594b5a6c2d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.network.neutron [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Updating instance_info_cache with network_info: [{"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Releasing lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance network_info: |[{"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-617906c4-c2a6-4212-940e-ed39851665ee req-7b67cd54-cdff-4811-b480-0f5569fcb2d5 service nova] Acquired lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.network.neutron [req-617906c4-c2a6-4212-940e-ed39851665ee req-7b67cd54-cdff-4811-b480-0f5569fcb2d5 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Refreshing network info cache for port daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee1910a8-88d2-438c-a17d-e8ca7f6a948a req-9dd01c4e-0f5b-4611-b6df-db860afa1a7c service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee1910a8-88d2-438c-a17d-e8ca7f6a948a req-9dd01c4e-0f5b-4611-b6df-db860afa1a7c service nova] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee1910a8-88d2-438c-a17d-e8ca7f6a948a req-9dd01c4e-0f5b-4611-b6df-db860afa1a7c service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee1910a8-88d2-438c-a17d-e8ca7f6a948a req-9dd01c4e-0f5b-4611-b6df-db860afa1a7c service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee1910a8-88d2-438c-a17d-e8ca7f6a948a req-9dd01c4e-0f5b-4611-b6df-db860afa1a7c service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] No waiting events found dispatching network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:06:20 user nova-compute[72178]: WARNING nova.compute.manager [req-ee1910a8-88d2-438c-a17d-e8ca7f6a948a req-9dd01c4e-0f5b-4611-b6df-db860afa1a7c service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received unexpected event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a for instance with vm_state building and task_state spawning.
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891580.6615064, 6341837b-67ea-42df-b3e9-c58e07857774 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:06:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] VM Resumed (Lifecycle Event)
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:06:20 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance spawned successfully.
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891580.6643152, 6341837b-67ea-42df-b3e9-c58e07857774 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:06:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] VM Started (Lifecycle Event)
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:06:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:06:20 user nova-compute[72178]: INFO nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 01 12:06:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:20 user nova-compute[72178]: INFO nova.compute.manager [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Took 7.57 seconds to build instance.
Aug 01 12:06:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-663340c6-3104-422f-bb42-c178d8071508 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.686s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:21 user nova-compute[72178]: DEBUG nova.network.neutron [req-617906c4-c2a6-4212-940e-ed39851665ee req-7b67cd54-cdff-4811-b480-0f5569fcb2d5 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Updated VIF entry in instance network info cache for port daf90b1b-c7ac-491e-abf6-4f082775e49e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:06:21 user nova-compute[72178]: DEBUG nova.network.neutron [req-617906c4-c2a6-4212-940e-ed39851665ee req-7b67cd54-cdff-4811-b480-0f5569fcb2d5 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Updating instance_info_cache with network_info: [{"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:06:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-617906c4-c2a6-4212-940e-ed39851665ee req-7b67cd54-cdff-4811-b480-0f5569fcb2d5 service nova] Releasing lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:06:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:06:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Creating image(s)
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Ensure instance console log exists: /opt/stack/data/nova/instances/69cbbc9f-ec82-4a40-9f91-3941db5088e4/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Start _get_guest_xml network_info=[{"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69cbbc9f-ec82-4a40-9f91-3941db5088e4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6622ae6-bbb1-420e-a2f7-89085dfb1a6f', 'serial': 'e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'}, 'boot_index': 0, 'attachment_id': 'db7679d4-67f3-4fe2-beff-b18d318cae15', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:06:24 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:06:24 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:06:24 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:06:24 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:06:24 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29c9b4d-0ce8-45a1-aaef-625c6b35bd96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:06:24 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f58751-6b63-4587-b1cb-05723a647b3f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f] added
Aug 01 12:06:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e60f0-5abf-4b89-bcaa-f97eaf43f64d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd032bf-7dcc-476f-838c-5bfba2eeac9d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQZDLiPh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQZDLiPh" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[deda7ccc-c5f9-46b9-955b-7bee3d92daa7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQZDLiPh'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7593c-9eac-4679-91f1-481f6e15d89c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9238e2c4-0c0a-4ff6-ad29-1ff90eafa0c3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:06:24 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:06:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:06:24 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:06:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[070e9a47-6dbe-4f9c-b9d1-8d1d2841112d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260]
Aug 01 12:06:24 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260] successful.
Aug 01 12:06:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32263a9-8f25-43b3-a8e9-c4d45e4eca7d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[638c1687-e5cc-4352-861e-2375ba6aef93]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:06:24 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:06:24 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:06:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:06:24 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:06:24 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:06:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff894f29-4e07-4e2a-a63f-4acb7a1c9b05]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:06:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26336643838343136', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336643838343136', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-828231296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-828231296',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxxZT+XJvl6cXt0RP6eIuO95cu9KfqyvLULPpXEBfcyImvOkOEINjqwZfkv7YYlz1KwfEdDpst8gzxwxzFCtDGY4W8U9WeIv8je0DaEQeVfjpEdkdvkrPrRgDiBrVWtgg==',key_name='tempest-keypair-1393248900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-68hqtqu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=69cbbc9f-ec82-4a40-9f91-3941db5088e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.objects.instance [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'pci_devices' on Instance uuid 69cbbc9f-ec82-4a40-9f91-3941db5088e4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:06:25 user nova-compute[72178]:   <uuid>69cbbc9f-ec82-4a40-9f91-3941db5088e4</uuid>
Aug 01 12:06:25 user nova-compute[72178]:   <name>instance-00000014</name>
Aug 01 12:06:25 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:06:25 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:06:25 user nova-compute[72178]:   <metadata>
Aug 01 12:06:25 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:06:25 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:06:25 user nova-compute[72178]:       <nova:name>tempest-ServerActionsV293TestJSON-server-828231296</nova:name>
Aug 01 12:06:25 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:06:24</nova:creationTime>
Aug 01 12:06:25 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:06:25 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:06:25 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:06:25 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:06:25 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:06:25 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:06:25 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:06:25 user nova-compute[72178]:       <nova:owner>
Aug 01 12:06:25 user nova-compute[72178]:         <nova:user uuid="551db946d0e94b50af2c5c659f4c82ce">tempest-ServerActionsV293TestJSON-1322074-project-member</nova:user>
Aug 01 12:06:25 user nova-compute[72178]:         <nova:project uuid="7ee13aa6423e4d33bfe59e2a092a5578">tempest-ServerActionsV293TestJSON-1322074</nova:project>
Aug 01 12:06:25 user nova-compute[72178]:       </nova:owner>
Aug 01 12:06:25 user nova-compute[72178]:       <nova:ports>
Aug 01 12:06:25 user nova-compute[72178]:         <nova:port uuid="daf90b1b-c7ac-491e-abf6-4f082775e49e">
Aug 01 12:06:25 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 12:06:25 user nova-compute[72178]:         </nova:port>
Aug 01 12:06:25 user nova-compute[72178]:       </nova:ports>
Aug 01 12:06:25 user nova-compute[72178]:     </nova:instance>
Aug 01 12:06:25 user nova-compute[72178]:   </metadata>
Aug 01 12:06:25 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:06:25 user nova-compute[72178]:     <system>
Aug 01 12:06:25 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:06:25 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:06:25 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:06:25 user nova-compute[72178]:       <entry name="serial">69cbbc9f-ec82-4a40-9f91-3941db5088e4</entry>
Aug 01 12:06:25 user nova-compute[72178]:       <entry name="uuid">69cbbc9f-ec82-4a40-9f91-3941db5088e4</entry>
Aug 01 12:06:25 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:06:25 user nova-compute[72178]:     </system>
Aug 01 12:06:25 user nova-compute[72178]:   </sysinfo>
Aug 01 12:06:25 user nova-compute[72178]:   <os>
Aug 01 12:06:25 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:06:25 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:06:25 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:06:25 user nova-compute[72178]:   </os>
Aug 01 12:06:25 user nova-compute[72178]:   <features>
Aug 01 12:06:25 user nova-compute[72178]:     <acpi/>
Aug 01 12:06:25 user nova-compute[72178]:     <apic/>
Aug 01 12:06:25 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:06:25 user nova-compute[72178]:   </features>
Aug 01 12:06:25 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:06:25 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:06:25 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:06:25 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:06:25 user nova-compute[72178]:   </clock>
Aug 01 12:06:25 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:06:25 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:06:25 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:06:25 user nova-compute[72178]:   </cpu>
Aug 01 12:06:25 user nova-compute[72178]:   <devices>
Aug 01 12:06:25 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:06:25 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:06:25 user nova-compute[72178]:       <source dev="/dev/sdc"/>
Aug 01 12:06:25 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:06:25 user nova-compute[72178]:       <serial>e6622ae6-bbb1-420e-a2f7-89085dfb1a6f</serial>
Aug 01 12:06:25 user nova-compute[72178]:     </disk>
Aug 01 12:06:25 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:06:25 user nova-compute[72178]:       <mac address="fa:16:3e:3f:e1:31"/>
Aug 01 12:06:25 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:06:25 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:06:25 user nova-compute[72178]:       <target dev="tapdaf90b1b-c7"/>
Aug 01 12:06:25 user nova-compute[72178]:     </interface>
Aug 01 12:06:25 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:06:25 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/69cbbc9f-ec82-4a40-9f91-3941db5088e4/console.log" append="off"/>
Aug 01 12:06:25 user nova-compute[72178]:     </serial>
Aug 01 12:06:25 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:06:25 user nova-compute[72178]:     <video>
Aug 01 12:06:25 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:06:25 user nova-compute[72178]:     </video>
Aug 01 12:06:25 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:06:25 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:06:25 user nova-compute[72178]:     </rng>
Aug 01 12:06:25 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:06:25 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:06:25 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:06:25 user nova-compute[72178]:     </memballoon>
Aug 01 12:06:25 user nova-compute[72178]:   </devices>
Aug 01 12:06:25 user nova-compute[72178]: </domain>
Aug 01 12:06:25 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-828231296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-828231296',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxxZT+XJvl6cXt0RP6eIuO95cu9KfqyvLULPpXEBfcyImvOkOEINjqwZfkv7YYlz1KwfEdDpst8gzxwxzFCtDGY4W8U9WeIv8je0DaEQeVfjpEdkdvkrPrRgDiBrVWtgg==',key_name='tempest-keypair-1393248900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-68hqtqu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=69cbbc9f-ec82-4a40-9f91-3941db5088e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG os_vif [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaf90b1b-c7, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdaf90b1b-c7, col_values=(('external_ids', {'iface-id': 'daf90b1b-c7ac-491e-abf6-4f082775e49e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:e1:31', 'vm-uuid': '69cbbc9f-ec82-4a40-9f91-3941db5088e4'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:06:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:25 user nova-compute[72178]: INFO os_vif [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7')
Aug 01 12:06:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] No VIF found with MAC fa:16:3e:3f:e1:31, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:06:26 user nova-compute[72178]: INFO nova.compute.claims [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Claim successful on node user
Aug 01 12:06:26 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:06:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:06:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG nova.policy [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5decc5e0a6b442c8ae65673dc854985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aad2b5a65c4d8b8cdacafe727db4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:06:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Creating image(s)
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "/opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "/opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "/opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-25265248-ea6f-4dca-9e3d-d8fb37edaffa req-fabfb08c-6adb-42a2-b3ef-5ff140e37d4c service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-25265248-ea6f-4dca-9e3d-d8fb37edaffa req-fabfb08c-6adb-42a2-b3ef-5ff140e37d4c service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-25265248-ea6f-4dca-9e3d-d8fb37edaffa req-fabfb08c-6adb-42a2-b3ef-5ff140e37d4c service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-25265248-ea6f-4dca-9e3d-d8fb37edaffa req-fabfb08c-6adb-42a2-b3ef-5ff140e37d4c service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-25265248-ea6f-4dca-9e3d-d8fb37edaffa req-fabfb08c-6adb-42a2-b3ef-5ff140e37d4c service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] No waiting events found dispatching network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:06:27 user nova-compute[72178]: WARNING nova.compute.manager [req-25265248-ea6f-4dca-9e3d-d8fb37edaffa req-fabfb08c-6adb-42a2-b3ef-5ff140e37d4c service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received unexpected event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e for instance with vm_state building and task_state spawning.
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff.part --force-share --output=json" returned: 0 in 0.159s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG nova.virt.images [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] 7f47eb43-d82d-4d50-a76b-fe78e3c3a21b was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff.part /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff.part /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff.converted" returned: 0 in 0.425s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG nova.network.neutron [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Successfully created port: b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.406s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff --force-share --output=json" returned: 0 in 0.155s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff,backing_fmt=raw /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff,backing_fmt=raw /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk 1073741824" returned: 0 in 0.073s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Cannot resize image /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG nova.objects.instance [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'migration_context' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Ensure instance console log exists: /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-1019a7e3-f307-43b6-9409-793c426be571 req-87f343b2-963c-4f5c-9f3b-9c5580d912c5 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1019a7e3-f307-43b6-9409-793c426be571 req-87f343b2-963c-4f5c-9f3b-9c5580d912c5 service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1019a7e3-f307-43b6-9409-793c426be571 req-87f343b2-963c-4f5c-9f3b-9c5580d912c5 service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1019a7e3-f307-43b6-9409-793c426be571 req-87f343b2-963c-4f5c-9f3b-9c5580d912c5 service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-1019a7e3-f307-43b6-9409-793c426be571 req-87f343b2-963c-4f5c-9f3b-9c5580d912c5 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] No waiting events found dispatching network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:06:29 user nova-compute[72178]: WARNING nova.compute.manager [req-1019a7e3-f307-43b6-9409-793c426be571 req-87f343b2-963c-4f5c-9f3b-9c5580d912c5 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received unexpected event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e for instance with vm_state building and task_state spawning.
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891590.1628044, 69cbbc9f-ec82-4a40-9f91-3941db5088e4 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:06:30 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] VM Resumed (Lifecycle Event)
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:06:30 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance spawned successfully.
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:06:30 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891590.171875, 69cbbc9f-ec82-4a40-9f91-3941db5088e4 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:06:30 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] VM Started (Lifecycle Event)
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:06:30 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:30 user nova-compute[72178]: INFO nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:06:30 user nova-compute[72178]: INFO nova.compute.manager [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Took 14.76 seconds to build instance.
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Successfully updated port: b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-88392820-5108-4f38-8ace-3c2f20597f2e tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.890s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquired lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating instance_info_cache with network_info: [{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Releasing lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Instance network_info: |[{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Start _get_guest_xml network_info=[{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T12:06:23Z,direct_url=<?>,disk_format='qcow2',id=7f47eb43-d82d-4d50-a76b-fe78e3c3a21b,min_disk=0,min_ram=0,name='tempest-scenario-img--1423369744',owner='c9aad2b5a65c4d8b8cdacafe727db4e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T12:06:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '7f47eb43-d82d-4d50-a76b-fe78e3c3a21b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:31 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:06:31 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T12:06:23Z,direct_url=<?>,disk_format='qcow2',id=7f47eb43-d82d-4d50-a76b-fe78e3c3a21b,min_disk=0,min_ram=0,name='tempest-scenario-img--1423369744',owner='c9aad2b5a65c4d8b8cdacafe727db4e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T12:06:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-284171792',display_name='tempest-TestMinimumBasicScenario-server-284171792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-284171792',id=21,image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8KTalSFvFaNrS1jliZnVrtNwKK4AozywHPcPo+QrbagBuFCxc3RURQwYNZ3xrdIYaSKaentOzwbBBIX4WKQeABSNCDvrrp7zftymG+1qdx+PWxJe8paCRFlMslpcuOw==',key_name='tempest-TestMinimumBasicScenario-121859531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-suzi3c00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:06:27Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.objects.instance [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'pci_devices' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:06:31 user nova-compute[72178]:   <uuid>d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb</uuid>
Aug 01 12:06:31 user nova-compute[72178]:   <name>instance-00000015</name>
Aug 01 12:06:31 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:06:31 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:06:31 user nova-compute[72178]:   <metadata>
Aug 01 12:06:31 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:06:31 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:06:31 user nova-compute[72178]:       <nova:name>tempest-TestMinimumBasicScenario-server-284171792</nova:name>
Aug 01 12:06:31 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:06:31</nova:creationTime>
Aug 01 12:06:31 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:06:31 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:06:31 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:06:31 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:06:31 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:06:31 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:06:31 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:06:31 user nova-compute[72178]:       <nova:owner>
Aug 01 12:06:31 user nova-compute[72178]:         <nova:user uuid="a5decc5e0a6b442c8ae65673dc854985">tempest-TestMinimumBasicScenario-1575364257-project-member</nova:user>
Aug 01 12:06:31 user nova-compute[72178]:         <nova:project uuid="c9aad2b5a65c4d8b8cdacafe727db4e3">tempest-TestMinimumBasicScenario-1575364257</nova:project>
Aug 01 12:06:31 user nova-compute[72178]:       </nova:owner>
Aug 01 12:06:31 user nova-compute[72178]:       <nova:root type="image" uuid="7f47eb43-d82d-4d50-a76b-fe78e3c3a21b"/>
Aug 01 12:06:31 user nova-compute[72178]:       <nova:ports>
Aug 01 12:06:31 user nova-compute[72178]:         <nova:port uuid="b6e7f28c-7e67-4026-9f1b-ca5884180e74">
Aug 01 12:06:31 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 12:06:31 user nova-compute[72178]:         </nova:port>
Aug 01 12:06:31 user nova-compute[72178]:       </nova:ports>
Aug 01 12:06:31 user nova-compute[72178]:     </nova:instance>
Aug 01 12:06:31 user nova-compute[72178]:   </metadata>
Aug 01 12:06:31 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:06:31 user nova-compute[72178]:     <system>
Aug 01 12:06:31 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:06:31 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:06:31 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:06:31 user nova-compute[72178]:       <entry name="serial">d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb</entry>
Aug 01 12:06:31 user nova-compute[72178]:       <entry name="uuid">d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb</entry>
Aug 01 12:06:31 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:06:31 user nova-compute[72178]:     </system>
Aug 01 12:06:31 user nova-compute[72178]:   </sysinfo>
Aug 01 12:06:31 user nova-compute[72178]:   <os>
Aug 01 12:06:31 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:06:31 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:06:31 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:06:31 user nova-compute[72178]:   </os>
Aug 01 12:06:31 user nova-compute[72178]:   <features>
Aug 01 12:06:31 user nova-compute[72178]:     <acpi/>
Aug 01 12:06:31 user nova-compute[72178]:     <apic/>
Aug 01 12:06:31 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:06:31 user nova-compute[72178]:   </features>
Aug 01 12:06:31 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:06:31 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:06:31 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:06:31 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:06:31 user nova-compute[72178]:   </clock>
Aug 01 12:06:31 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:06:31 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:06:31 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:06:31 user nova-compute[72178]:   </cpu>
Aug 01 12:06:31 user nova-compute[72178]:   <devices>
Aug 01 12:06:31 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:06:31 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:06:31 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk"/>
Aug 01 12:06:31 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:06:31 user nova-compute[72178]:     </disk>
Aug 01 12:06:31 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:06:31 user nova-compute[72178]:       <mac address="fa:16:3e:6f:fc:37"/>
Aug 01 12:06:31 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:06:31 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:06:31 user nova-compute[72178]:       <target dev="tapb6e7f28c-7e"/>
Aug 01 12:06:31 user nova-compute[72178]:     </interface>
Aug 01 12:06:31 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:06:31 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/console.log" append="off"/>
Aug 01 12:06:31 user nova-compute[72178]:     </serial>
Aug 01 12:06:31 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:06:31 user nova-compute[72178]:     <video>
Aug 01 12:06:31 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:06:31 user nova-compute[72178]:     </video>
Aug 01 12:06:31 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:06:31 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:06:31 user nova-compute[72178]:     </rng>
Aug 01 12:06:31 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:06:31 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:06:31 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:06:31 user nova-compute[72178]:     </memballoon>
Aug 01 12:06:31 user nova-compute[72178]:   </devices>
Aug 01 12:06:31 user nova-compute[72178]: </domain>
Aug 01 12:06:31 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-284171792',display_name='tempest-TestMinimumBasicScenario-server-284171792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-284171792',id=21,image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8KTalSFvFaNrS1jliZnVrtNwKK4AozywHPcPo+QrbagBuFCxc3RURQwYNZ3xrdIYaSKaentOzwbBBIX4WKQeABSNCDvrrp7zftymG+1qdx+PWxJe8paCRFlMslpcuOw==',key_name='tempest-TestMinimumBasicScenario-121859531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-suzi3c00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:06:27Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG os_vif [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6e7f28c-7e, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6e7f28c-7e, col_values=(('external_ids', {'iface-id': 'b6e7f28c-7e67-4026-9f1b-ca5884180e74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:fc:37', 'vm-uuid': 'd24e0764-b1cf-4b56-bcfe-73e92ed7c7fb'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:31 user nova-compute[72178]: INFO os_vif [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e')
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No VIF found with MAC fa:16:3e:6f:fc:37, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-70e38251-fa4a-4c11-ae2e-2d1905a87906 req-d1788b58-0dcc-45a3-8c82-f6bd896d69fc service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-70e38251-fa4a-4c11-ae2e-2d1905a87906 req-d1788b58-0dcc-45a3-8c82-f6bd896d69fc service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing instance network info cache due to event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-70e38251-fa4a-4c11-ae2e-2d1905a87906 req-d1788b58-0dcc-45a3-8c82-f6bd896d69fc service nova] Acquiring lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-70e38251-fa4a-4c11-ae2e-2d1905a87906 req-d1788b58-0dcc-45a3-8c82-f6bd896d69fc service nova] Acquired lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-70e38251-fa4a-4c11-ae2e-2d1905a87906 req-d1788b58-0dcc-45a3-8c82-f6bd896d69fc service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-70e38251-fa4a-4c11-ae2e-2d1905a87906 req-d1788b58-0dcc-45a3-8c82-f6bd896d69fc service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updated VIF entry in instance network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-70e38251-fa4a-4c11-ae2e-2d1905a87906 req-d1788b58-0dcc-45a3-8c82-f6bd896d69fc service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating instance_info_cache with network_info: [{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-70e38251-fa4a-4c11-ae2e-2d1905a87906 req-d1788b58-0dcc-45a3-8c82-f6bd896d69fc service nova] Releasing lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:06:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:06:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:06:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-d7a7c280-b1d2-40b8-9235-6126ba9fa9ce req-957a4d09-9418-4e93-9a70-1b2c9bce9cc6 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d7a7c280-b1d2-40b8-9235-6126ba9fa9ce req-957a4d09-9418-4e93-9a70-1b2c9bce9cc6 service nova] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d7a7c280-b1d2-40b8-9235-6126ba9fa9ce req-957a4d09-9418-4e93-9a70-1b2c9bce9cc6 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d7a7c280-b1d2-40b8-9235-6126ba9fa9ce req-957a4d09-9418-4e93-9a70-1b2c9bce9cc6 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-d7a7c280-b1d2-40b8-9235-6126ba9fa9ce req-957a4d09-9418-4e93-9a70-1b2c9bce9cc6 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] No waiting events found dispatching network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:06:34 user nova-compute[72178]: WARNING nova.compute.manager [req-d7a7c280-b1d2-40b8-9235-6126ba9fa9ce req-957a4d09-9418-4e93-9a70-1b2c9bce9cc6 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received unexpected event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 for instance with vm_state building and task_state spawning.
Aug 01 12:06:34 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:06:34 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7566MB free_disk=25.393753051757812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f4ae1965-8660-4deb-8427-cafa57f837c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6341837b-67ea-42df-b3e9-c58e07857774 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 69cbbc9f-ec82-4a40-9f91-3941db5088e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:06:34 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-f7c5aaac-9083-45be-872a-ec1f081e51ac req-06fd8d33-a10b-47df-a172-d3e3d7f26ded service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7c5aaac-9083-45be-872a-ec1f081e51ac req-06fd8d33-a10b-47df-a172-d3e3d7f26ded service nova] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7c5aaac-9083-45be-872a-ec1f081e51ac req-06fd8d33-a10b-47df-a172-d3e3d7f26ded service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7c5aaac-9083-45be-872a-ec1f081e51ac req-06fd8d33-a10b-47df-a172-d3e3d7f26ded service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-f7c5aaac-9083-45be-872a-ec1f081e51ac req-06fd8d33-a10b-47df-a172-d3e3d7f26ded service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] No waiting events found dispatching network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:06:35 user nova-compute[72178]: WARNING nova.compute.manager [req-f7c5aaac-9083-45be-872a-ec1f081e51ac req-06fd8d33-a10b-47df-a172-d3e3d7f26ded service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received unexpected event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 for instance with vm_state building and task_state spawning.
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891595.9452164, d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:06:35 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] VM Resumed (Lifecycle Event)
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:06:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Instance spawned successfully.
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:06:36 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:06:36 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891595.9462893, d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:06:36 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] VM Started (Lifecycle Event)
Aug 01 12:06:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:06:36 user nova-compute[72178]: INFO nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Took 8.85 seconds to spawn the instance on the hypervisor.
Aug 01 12:06:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:06:36 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:06:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:06:36 user nova-compute[72178]: INFO nova.compute.manager [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Took 9.68 seconds to build instance.
Aug 01 12:06:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-883dc410-61f4-44c4-99d4-f1a630299d4f tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.801s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:06:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:06:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "65e21777-de00-4f0a-9774-c1305ac68a43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:07:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:15 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:07:15 user nova-compute[72178]: INFO nova.compute.claims [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Claim successful on node user
Aug 01 12:07:16 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:07:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:07:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:07:16 user nova-compute[72178]: INFO nova.virt.block_device [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Booting with volume 046fadda-0003-4747-929b-4c5215e18c4b at /dev/vda
Aug 01 12:07:16 user nova-compute[72178]: DEBUG os_brick.utils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG nova.policy [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f716d894c2dc4c6b8c73bbb26c8423be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '772835a74e894918b57dc09ea4aa50f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[305b2c69-3808-4ca3-861f-bba209c2afda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9848ac5f-d5e1-47c1-9e45-fced3d1e3bba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1f3222-f62f-4dcc-9b96-7e3b157cbc57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cc87ab-88e5-44dc-b6dd-d70b9c3e3144]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:07:16 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:07:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d622b144-64a1-438f-8ead-bee0631d3df0]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG os_brick.utils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:16 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating existing volume attachment record: 0f4dc66e-7144-4955-91d8-14e1d9f0e041 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:07:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully created port: 0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully created port: eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:19 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully created port: 38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:20 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully created port: 10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:20 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully created port: 77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully updated port: 0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-1f4eed6f-f284-4a7b-904d-97fabb2b9588 req-2b285864-ca37-47a4-ba83-604742f155c2 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-changed-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-1f4eed6f-f284-4a7b-904d-97fabb2b9588 req-2b285864-ca37-47a4-ba83-604742f155c2 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing instance network info cache due to event network-changed-0222d3a2-c922-4175-b9d9-9962d26eeda7. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1f4eed6f-f284-4a7b-904d-97fabb2b9588 req-2b285864-ca37-47a4-ba83-604742f155c2 service nova] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1f4eed6f-f284-4a7b-904d-97fabb2b9588 req-2b285864-ca37-47a4-ba83-604742f155c2 service nova] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG nova.network.neutron [req-1f4eed6f-f284-4a7b-904d-97fabb2b9588 req-2b285864-ca37-47a4-ba83-604742f155c2 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing network info cache for port 0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG nova.network.neutron [req-1f4eed6f-f284-4a7b-904d-97fabb2b9588 req-2b285864-ca37-47a4-ba83-604742f155c2 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG nova.network.neutron [req-1f4eed6f-f284-4a7b-904d-97fabb2b9588 req-2b285864-ca37-47a4-ba83-604742f155c2 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1f4eed6f-f284-4a7b-904d-97fabb2b9588 req-2b285864-ca37-47a4-ba83-604742f155c2 service nova] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully updated port: c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-6bff22b1-58dd-4f3c-bca9-4af4750e260c req-62ae88d9-8f4f-4372-99ac-7e20a6c5cc2c service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-changed-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-6bff22b1-58dd-4f3c-bca9-4af4750e260c req-62ae88d9-8f4f-4372-99ac-7e20a6c5cc2c service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing instance network info cache due to event network-changed-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6bff22b1-58dd-4f3c-bca9-4af4750e260c req-62ae88d9-8f4f-4372-99ac-7e20a6c5cc2c service nova] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6bff22b1-58dd-4f3c-bca9-4af4750e260c req-62ae88d9-8f4f-4372-99ac-7e20a6c5cc2c service nova] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG nova.network.neutron [req-6bff22b1-58dd-4f3c-bca9-4af4750e260c req-62ae88d9-8f4f-4372-99ac-7e20a6c5cc2c service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing network info cache for port c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG nova.network.neutron [req-6bff22b1-58dd-4f3c-bca9-4af4750e260c req-62ae88d9-8f4f-4372-99ac-7e20a6c5cc2c service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:07:24 user nova-compute[72178]: INFO nova.compute.claims [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Claim successful on node user
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.network.neutron [req-6bff22b1-58dd-4f3c-bca9-4af4750e260c req-62ae88d9-8f4f-4372-99ac-7e20a6c5cc2c service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6bff22b1-58dd-4f3c-bca9-4af4750e260c req-62ae88d9-8f4f-4372-99ac-7e20a6c5cc2c service nova] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully updated port: 0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.645s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:07:25 user nova-compute[72178]: INFO nova.virt.block_device [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Booting with volume 4f17261c-e322-48ac-be2c-700108c830a8 at /dev/vdb
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.network.neutron [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:07:25 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG os_brick.utils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb33f93-dc73-40c9-abf7-cab38ad83920]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.policy [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f27c80bc14843e6a250f1df6e40f26f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee85194306f544e8be7c1a8d2ba4656c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3832f6-032c-48d0-a5e6-25d8ae3cd11d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[474df0cb-b8d0-4bb0-a686-dd614608c491]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[358b7edf-5532-41d7-9039-2195552b563f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:07:25 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a8ed1b-471e-43a4-9930-33ca16815993]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG os_brick.utils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating existing volume attachment record: 5851b159-feaf-4c24-ae21-1ce834a974aa {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:07:25 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Creating image(s)
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "/opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "/opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.176s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk 1073741824" returned: 0 in 0.052s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.compute.manager [req-099d1f9a-18a6-475e-9515-059dd9e0bb69 req-0e7115fe-3bd9-4ba0-aeeb-ea625f9b75d4 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-changed-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.compute.manager [req-099d1f9a-18a6-475e-9515-059dd9e0bb69 req-0e7115fe-3bd9-4ba0-aeeb-ea625f9b75d4 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing instance network info cache due to event network-changed-0654efa4-1f8e-45f5-85fb-07d2749de7d8. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-099d1f9a-18a6-475e-9515-059dd9e0bb69 req-0e7115fe-3bd9-4ba0-aeeb-ea625f9b75d4 service nova] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-099d1f9a-18a6-475e-9515-059dd9e0bb69 req-0e7115fe-3bd9-4ba0-aeeb-ea625f9b75d4 service nova] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.network.neutron [req-099d1f9a-18a6-475e-9515-059dd9e0bb69 req-0e7115fe-3bd9-4ba0-aeeb-ea625f9b75d4 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing network info cache for port 0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.network.neutron [req-099d1f9a-18a6-475e-9515-059dd9e0bb69 req-0e7115fe-3bd9-4ba0-aeeb-ea625f9b75d4 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.network.neutron [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Successfully created port: 56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Cannot resize image /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.objects.instance [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'migration_context' on Instance uuid 45795fb0-12dd-4acc-990c-d1192e1ab54b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Ensure instance console log exists: /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG nova.network.neutron [req-099d1f9a-18a6-475e-9515-059dd9e0bb69 req-0e7115fe-3bd9-4ba0-aeeb-ea625f9b75d4 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-099d1f9a-18a6-475e-9515-059dd9e0bb69 req-0e7115fe-3bd9-4ba0-aeeb-ea625f9b75d4 service nova] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully updated port: eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:07:27 user nova-compute[72178]: INFO nova.compute.claims [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Claim successful on node user
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Successfully updated port: 56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquired lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-af1c947d-8f51-4634-ac5d-a275d73bbacf req-dca4c826-e2c2-4b8f-b614-bef97320e9cb service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-changed-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-af1c947d-8f51-4634-ac5d-a275d73bbacf req-dca4c826-e2c2-4b8f-b614-bef97320e9cb service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Refreshing instance network info cache due to event network-changed-56751746-774a-4955-a547-c09eff25e5b5. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-af1c947d-8f51-4634-ac5d-a275d73bbacf req-dca4c826-e2c2-4b8f-b614-bef97320e9cb service nova] Acquiring lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Updating instance_info_cache with network_info: [{"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Releasing lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Instance network_info: |[{"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-af1c947d-8f51-4634-ac5d-a275d73bbacf req-dca4c826-e2c2-4b8f-b614-bef97320e9cb service nova] Acquired lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.neutron [req-af1c947d-8f51-4634-ac5d-a275d73bbacf req-dca4c826-e2c2-4b8f-b614-bef97320e9cb service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Refreshing network info cache for port 56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Start _get_guest_xml network_info=[{"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:07:27 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:27 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2004812366',display_name='tempest-ServerRescueNegativeTestJSON-server-2004812366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2004812366',id=23,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbBYsqJ9jde0PSiVyxKEVdLH1IKsqZ/24z3X+71JN8pEHFQwCCa9axMDxJod/5q+2BU2do9Sc0gEcxKbZZXkJ38MVPEo7SP0XWZq33JT0yJWyWZJA33Lwfbje5GLqCm1A==',key_name='tempest-keypair-72150570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-vujhbl6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=45795fb0-12dd-4acc-990c-d1192e1ab54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:5a:c7,bridge_name='br-int',has_traffic_filtering=True,id=56751746-774a-4955-a547-c09eff25e5b5,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56751746-77') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.objects.instance [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'pci_devices' on Instance uuid 45795fb0-12dd-4acc-990c-d1192e1ab54b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:07:27 user nova-compute[72178]:   <uuid>45795fb0-12dd-4acc-990c-d1192e1ab54b</uuid>
Aug 01 12:07:27 user nova-compute[72178]:   <name>instance-00000017</name>
Aug 01 12:07:27 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:07:27 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:07:27 user nova-compute[72178]:   <metadata>
Aug 01 12:07:27 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:07:27 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:07:27 user nova-compute[72178]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2004812366</nova:name>
Aug 01 12:07:27 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:07:27</nova:creationTime>
Aug 01 12:07:27 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:07:27 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:07:27 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:07:27 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:07:27 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:07:27 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:07:27 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:07:27 user nova-compute[72178]:       <nova:owner>
Aug 01 12:07:27 user nova-compute[72178]:         <nova:user uuid="6f27c80bc14843e6a250f1df6e40f26f">tempest-ServerRescueNegativeTestJSON-1377634293-project-member</nova:user>
Aug 01 12:07:27 user nova-compute[72178]:         <nova:project uuid="ee85194306f544e8be7c1a8d2ba4656c">tempest-ServerRescueNegativeTestJSON-1377634293</nova:project>
Aug 01 12:07:27 user nova-compute[72178]:       </nova:owner>
Aug 01 12:07:27 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:07:27 user nova-compute[72178]:       <nova:ports>
Aug 01 12:07:27 user nova-compute[72178]:         <nova:port uuid="56751746-774a-4955-a547-c09eff25e5b5">
Aug 01 12:07:27 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 12:07:27 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:27 user nova-compute[72178]:       </nova:ports>
Aug 01 12:07:27 user nova-compute[72178]:     </nova:instance>
Aug 01 12:07:27 user nova-compute[72178]:   </metadata>
Aug 01 12:07:27 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:07:27 user nova-compute[72178]:     <system>
Aug 01 12:07:27 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:07:27 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:07:27 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:07:27 user nova-compute[72178]:       <entry name="serial">45795fb0-12dd-4acc-990c-d1192e1ab54b</entry>
Aug 01 12:07:27 user nova-compute[72178]:       <entry name="uuid">45795fb0-12dd-4acc-990c-d1192e1ab54b</entry>
Aug 01 12:07:27 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:07:27 user nova-compute[72178]:     </system>
Aug 01 12:07:27 user nova-compute[72178]:   </sysinfo>
Aug 01 12:07:27 user nova-compute[72178]:   <os>
Aug 01 12:07:27 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:07:27 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:07:27 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:07:27 user nova-compute[72178]:   </os>
Aug 01 12:07:27 user nova-compute[72178]:   <features>
Aug 01 12:07:27 user nova-compute[72178]:     <acpi/>
Aug 01 12:07:27 user nova-compute[72178]:     <apic/>
Aug 01 12:07:27 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:07:27 user nova-compute[72178]:   </features>
Aug 01 12:07:27 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:07:27 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:07:27 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:07:27 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:07:27 user nova-compute[72178]:   </clock>
Aug 01 12:07:27 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:07:27 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:07:27 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:07:27 user nova-compute[72178]:   </cpu>
Aug 01 12:07:27 user nova-compute[72178]:   <devices>
Aug 01 12:07:27 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:07:27 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:07:27 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk"/>
Aug 01 12:07:27 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:07:27 user nova-compute[72178]:     </disk>
Aug 01 12:07:27 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:27 user nova-compute[72178]:       <mac address="fa:16:3e:44:5a:c7"/>
Aug 01 12:07:27 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:27 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:27 user nova-compute[72178]:       <target dev="tap56751746-77"/>
Aug 01 12:07:27 user nova-compute[72178]:     </interface>
Aug 01 12:07:27 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:07:27 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/console.log" append="off"/>
Aug 01 12:07:27 user nova-compute[72178]:     </serial>
Aug 01 12:07:27 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:07:27 user nova-compute[72178]:     <video>
Aug 01 12:07:27 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:27 user nova-compute[72178]:     </video>
Aug 01 12:07:27 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:07:27 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:07:27 user nova-compute[72178]:     </rng>
Aug 01 12:07:27 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:07:27 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:07:27 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:07:27 user nova-compute[72178]:     </memballoon>
Aug 01 12:07:27 user nova-compute[72178]:   </devices>
Aug 01 12:07:27 user nova-compute[72178]: </domain>
Aug 01 12:07:27 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2004812366',display_name='tempest-ServerRescueNegativeTestJSON-server-2004812366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2004812366',id=23,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbBYsqJ9jde0PSiVyxKEVdLH1IKsqZ/24z3X+71JN8pEHFQwCCa9axMDxJod/5q+2BU2do9Sc0gEcxKbZZXkJ38MVPEo7SP0XWZq33JT0yJWyWZJA33Lwfbje5GLqCm1A==',key_name='tempest-keypair-72150570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-vujhbl6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=45795fb0-12dd-4acc-990c-d1192e1ab54b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:5a:c7,bridge_name='br-int',has_traffic_filtering=True,id=56751746-774a-4955-a547-c09eff25e5b5,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56751746-77') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG os_vif [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:5a:c7,bridge_name='br-int',has_traffic_filtering=True,id=56751746-774a-4955-a547-c09eff25e5b5,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56751746-77') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56751746-77, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap56751746-77, col_values=(('external_ids', {'iface-id': '56751746-774a-4955-a547-c09eff25e5b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:5a:c7', 'vm-uuid': '45795fb0-12dd-4acc-990c-d1192e1ab54b'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:27 user nova-compute[72178]: INFO os_vif [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:5a:c7,bridge_name='br-int',has_traffic_filtering=True,id=56751746-774a-4955-a547-c09eff25e5b5,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56751746-77')
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:07:27 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] No VIF found with MAC fa:16:3e:44:5a:c7, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.network.neutron [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:07:28 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:07:28 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Creating image(s)
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "/opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "/opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "/opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.compute.manager [req-fcb09868-428b-4fff-a9d1-7dbfa20edaa9 req-f70c2b04-8399-46d6-ac24-5f302b1a6f08 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-changed-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.compute.manager [req-fcb09868-428b-4fff-a9d1-7dbfa20edaa9 req-f70c2b04-8399-46d6-ac24-5f302b1a6f08 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing instance network info cache due to event network-changed-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fcb09868-428b-4fff-a9d1-7dbfa20edaa9 req-f70c2b04-8399-46d6-ac24-5f302b1a6f08 service nova] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fcb09868-428b-4fff-a9d1-7dbfa20edaa9 req-f70c2b04-8399-46d6-ac24-5f302b1a6f08 service nova] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.network.neutron [req-fcb09868-428b-4fff-a9d1-7dbfa20edaa9 req-f70c2b04-8399-46d6-ac24-5f302b1a6f08 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing network info cache for port eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.policy [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec0992e3a27a4a44922268a46b27ad83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2fc3212d24561b0b971241fe367ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.network.neutron [req-af1c947d-8f51-4634-ac5d-a275d73bbacf req-dca4c826-e2c2-4b8f-b614-bef97320e9cb service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Updated VIF entry in instance network info cache for port 56751746-774a-4955-a547-c09eff25e5b5. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.network.neutron [req-af1c947d-8f51-4634-ac5d-a275d73bbacf req-dca4c826-e2c2-4b8f-b614-bef97320e9cb service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Updating instance_info_cache with network_info: [{"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-af1c947d-8f51-4634-ac5d-a275d73bbacf req-dca4c826-e2c2-4b8f-b614-bef97320e9cb service nova] Releasing lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.network.neutron [req-fcb09868-428b-4fff-a9d1-7dbfa20edaa9 req-f70c2b04-8399-46d6-ac24-5f302b1a6f08 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk 1073741824" returned: 0 in 0.068s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully updated port: 38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Checking if we can resize image /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Cannot resize image /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.objects.instance [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'migration_context' on Instance uuid 004ce11d-31dc-41dc-a5ac-b639c4c8486d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Ensure instance console log exists: /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:28 user nova-compute[72178]: DEBUG nova.network.neutron [req-fcb09868-428b-4fff-a9d1-7dbfa20edaa9 req-f70c2b04-8399-46d6-ac24-5f302b1a6f08 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fcb09868-428b-4fff-a9d1-7dbfa20edaa9 req-f70c2b04-8399-46d6-ac24-5f302b1a6f08 service nova] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:29 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:07:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-6ed3d617-e8ad-4190-865d-914d23c28770 req-7123f2cc-9a8c-4081-995c-2cf5a89cd727 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-changed-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-6ed3d617-e8ad-4190-865d-914d23c28770 req-7123f2cc-9a8c-4081-995c-2cf5a89cd727 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing instance network info cache due to event network-changed-38efafbc-6dde-4d99-9210-7231eac9baec. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6ed3d617-e8ad-4190-865d-914d23c28770 req-7123f2cc-9a8c-4081-995c-2cf5a89cd727 service nova] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6ed3d617-e8ad-4190-865d-914d23c28770 req-7123f2cc-9a8c-4081-995c-2cf5a89cd727 service nova] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG nova.network.neutron [req-6ed3d617-e8ad-4190-865d-914d23c28770 req-7123f2cc-9a8c-4081-995c-2cf5a89cd727 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing network info cache for port 38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Successfully created port: 7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:30 user nova-compute[72178]: DEBUG nova.network.neutron [req-6ed3d617-e8ad-4190-865d-914d23c28770 req-7123f2cc-9a8c-4081-995c-2cf5a89cd727 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891651.742713, 45795fb0-12dd-4acc-990c-d1192e1ab54b => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:07:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] VM Resumed (Lifecycle Event)
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:07:31 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Instance spawned successfully.
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:07:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891651.7447436, 45795fb0-12dd-4acc-990c-d1192e1ab54b => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:07:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] VM Started (Lifecycle Event)
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:07:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.network.neutron [req-6ed3d617-e8ad-4190-865d-914d23c28770 req-7123f2cc-9a8c-4081-995c-2cf5a89cd727 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6ed3d617-e8ad-4190-865d-914d23c28770 req-7123f2cc-9a8c-4081-995c-2cf5a89cd727 service nova] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:31 user nova-compute[72178]: INFO nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Took 6.22 seconds to spawn the instance on the hypervisor.
Aug 01 12:07:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:32 user nova-compute[72178]: INFO nova.compute.manager [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Took 7.41 seconds to build instance.
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fe3e27c2-6e71-4609-809e-4f86c584d452 tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.538s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully updated port: 10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] No waiting events found dispatching network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:32 user nova-compute[72178]: WARNING nova.compute.manager [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received unexpected event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 for instance with vm_state active and task_state None.
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] No waiting events found dispatching network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:32 user nova-compute[72178]: WARNING nova.compute.manager [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received unexpected event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 for instance with vm_state active and task_state None.
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-changed-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing instance network info cache due to event network-changed-10b42e49-0aec-4c43-8007-a256bd95956a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing network info cache for port 10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:07:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG nova.network.neutron [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1c65e25f-ab04-408b-9bc5-d79b912dcb85 req-0de2208b-e8cd-4a60-91c7-a3d4732d2849 service nova] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.297s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: INFO nova.virt.block_device [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Booting with volume e73d7de4-10a9-4fc8-a9c8-3ee966218124 at /dev/vdc
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG os_brick.utils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7570e87-6065-439e-ac91-49c69a1da94f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[21982147-5406-4bae-845f-91e0a6be3520]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb34e57-19b4-4d54-b89b-c094963f2d37]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb285e1-0030-4136-8204-30ace5b7e63d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:07:35 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b07346-b4b5-45df-87e6-def79c85fbe1]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG os_brick.utils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== get_connector_properties: return (221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating existing volume attachment record: 4df33ba8-dc6d-4124-b82a-fb62939d0038 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Successfully updated port: 7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "refresh_cache-004ce11d-31dc-41dc-a5ac-b639c4c8486d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquired lock "refresh_cache-004ce11d-31dc-41dc-a5ac-b639c4c8486d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-77497ca8-4cc5-4d26-9497-89f592ae1a35 req-3c0c28e0-6da8-46f8-bad6-e66923ff1bfa service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received event network-changed-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-77497ca8-4cc5-4d26-9497-89f592ae1a35 req-3c0c28e0-6da8-46f8-bad6-e66923ff1bfa service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Refreshing instance network info cache due to event network-changed-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-77497ca8-4cc5-4d26-9497-89f592ae1a35 req-3c0c28e0-6da8-46f8-bad6-e66923ff1bfa service nova] Acquiring lock "refresh_cache-004ce11d-31dc-41dc-a5ac-b639c4c8486d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:07:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Successfully updated port: 77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.network.neutron [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Updating instance_info_cache with network_info: [{"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:37 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:37 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7298MB free_disk=25.319965362548828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Releasing lock "refresh_cache-004ce11d-31dc-41dc-a5ac-b639c4c8486d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Instance network_info: |[{"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-77497ca8-4cc5-4d26-9497-89f592ae1a35 req-3c0c28e0-6da8-46f8-bad6-e66923ff1bfa service nova] Acquired lock "refresh_cache-004ce11d-31dc-41dc-a5ac-b639c4c8486d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.network.neutron [req-77497ca8-4cc5-4d26-9497-89f592ae1a35 req-3c0c28e0-6da8-46f8-bad6-e66923ff1bfa service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Refreshing network info cache for port 7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Start _get_guest_xml network_info=[{"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:07:37 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:37 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-250235509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-250235509',id=24,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-tpaphul1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:28Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=004ce11d-31dc-41dc-a5ac-b639c4c8486d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5f:57,bridge_name='br-int',has_traffic_filtering=True,id=7f9a086d-a7d3-4d59-80c2-e2db1415b5a7,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9a086d-a7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.objects.instance [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'pci_devices' on Instance uuid 004ce11d-31dc-41dc-a5ac-b639c4c8486d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:07:37 user nova-compute[72178]:   <uuid>004ce11d-31dc-41dc-a5ac-b639c4c8486d</uuid>
Aug 01 12:07:37 user nova-compute[72178]:   <name>instance-00000018</name>
Aug 01 12:07:37 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:07:37 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:07:37 user nova-compute[72178]:   <metadata>
Aug 01 12:07:37 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:07:37 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:07:37 user nova-compute[72178]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-250235509</nova:name>
Aug 01 12:07:37 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:07:37</nova:creationTime>
Aug 01 12:07:37 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:07:37 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:07:37 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:07:37 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:07:37 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:07:37 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:07:37 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:07:37 user nova-compute[72178]:       <nova:owner>
Aug 01 12:07:37 user nova-compute[72178]:         <nova:user uuid="ec0992e3a27a4a44922268a46b27ad83">tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member</nova:user>
Aug 01 12:07:37 user nova-compute[72178]:         <nova:project uuid="d5e2fc3212d24561b0b971241fe367ec">tempest-ServerBootFromVolumeStableRescueTest-2013636577</nova:project>
Aug 01 12:07:37 user nova-compute[72178]:       </nova:owner>
Aug 01 12:07:37 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:07:37 user nova-compute[72178]:       <nova:ports>
Aug 01 12:07:37 user nova-compute[72178]:         <nova:port uuid="7f9a086d-a7d3-4d59-80c2-e2db1415b5a7">
Aug 01 12:07:37 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:07:37 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:37 user nova-compute[72178]:       </nova:ports>
Aug 01 12:07:37 user nova-compute[72178]:     </nova:instance>
Aug 01 12:07:37 user nova-compute[72178]:   </metadata>
Aug 01 12:07:37 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:07:37 user nova-compute[72178]:     <system>
Aug 01 12:07:37 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:07:37 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:07:37 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:07:37 user nova-compute[72178]:       <entry name="serial">004ce11d-31dc-41dc-a5ac-b639c4c8486d</entry>
Aug 01 12:07:37 user nova-compute[72178]:       <entry name="uuid">004ce11d-31dc-41dc-a5ac-b639c4c8486d</entry>
Aug 01 12:07:37 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:07:37 user nova-compute[72178]:     </system>
Aug 01 12:07:37 user nova-compute[72178]:   </sysinfo>
Aug 01 12:07:37 user nova-compute[72178]:   <os>
Aug 01 12:07:37 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:07:37 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:07:37 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:07:37 user nova-compute[72178]:   </os>
Aug 01 12:07:37 user nova-compute[72178]:   <features>
Aug 01 12:07:37 user nova-compute[72178]:     <acpi/>
Aug 01 12:07:37 user nova-compute[72178]:     <apic/>
Aug 01 12:07:37 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:07:37 user nova-compute[72178]:   </features>
Aug 01 12:07:37 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:07:37 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:07:37 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:07:37 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:07:37 user nova-compute[72178]:   </clock>
Aug 01 12:07:37 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:07:37 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:07:37 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:07:37 user nova-compute[72178]:   </cpu>
Aug 01 12:07:37 user nova-compute[72178]:   <devices>
Aug 01 12:07:37 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:07:37 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:07:37 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk"/>
Aug 01 12:07:37 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:07:37 user nova-compute[72178]:     </disk>
Aug 01 12:07:37 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:37 user nova-compute[72178]:       <mac address="fa:16:3e:c3:5f:57"/>
Aug 01 12:07:37 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:37 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:37 user nova-compute[72178]:       <target dev="tap7f9a086d-a7"/>
Aug 01 12:07:37 user nova-compute[72178]:     </interface>
Aug 01 12:07:37 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:07:37 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/console.log" append="off"/>
Aug 01 12:07:37 user nova-compute[72178]:     </serial>
Aug 01 12:07:37 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:07:37 user nova-compute[72178]:     <video>
Aug 01 12:07:37 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:37 user nova-compute[72178]:     </video>
Aug 01 12:07:37 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:07:37 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:07:37 user nova-compute[72178]:     </rng>
Aug 01 12:07:37 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:07:37 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:07:37 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:07:37 user nova-compute[72178]:     </memballoon>
Aug 01 12:07:37 user nova-compute[72178]:   </devices>
Aug 01 12:07:37 user nova-compute[72178]: </domain>
Aug 01 12:07:37 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-250235509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-250235509',id=24,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-tpaphul1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:28Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=004ce11d-31dc-41dc-a5ac-b639c4c8486d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5f:57,bridge_name='br-int',has_traffic_filtering=True,id=7f9a086d-a7d3-4d59-80c2-e2db1415b5a7,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9a086d-a7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG os_vif [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5f:57,bridge_name='br-int',has_traffic_filtering=True,id=7f9a086d-a7d3-4d59-80c2-e2db1415b5a7,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9a086d-a7') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f9a086d-a7, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f9a086d-a7, col_values=(('external_ids', {'iface-id': '7f9a086d-a7d3-4d59-80c2-e2db1415b5a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:5f:57', 'vm-uuid': '004ce11d-31dc-41dc-a5ac-b639c4c8486d'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:37 user nova-compute[72178]: INFO os_vif [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5f:57,bridge_name='br-int',has_traffic_filtering=True,id=7f9a086d-a7d3-4d59-80c2-e2db1415b5a7,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9a086d-a7')
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f4ae1965-8660-4deb-8427-cafa57f837c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6341837b-67ea-42df-b3e9-c58e07857774 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 69cbbc9f-ec82-4a40-9f91-3941db5088e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 65e21777-de00-4f0a-9774-c1305ac68a43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 45795fb0-12dd-4acc-990c-d1192e1ab54b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No VIF found with MAC fa:16:3e:c3:5f:57, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-995ee2e0-4d05-4310-941c-4ed0f3873adb req-ca2fce22-ab12-4d9d-9cb9-6a13d923ded7 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-changed-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-995ee2e0-4d05-4310-941c-4ed0f3873adb req-ca2fce22-ab12-4d9d-9cb9-6a13d923ded7 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing instance network info cache due to event network-changed-77ce169c-f4ed-4da4-895f-57f0f1505f56. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-995ee2e0-4d05-4310-941c-4ed0f3873adb req-ca2fce22-ab12-4d9d-9cb9-6a13d923ded7 service nova] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.934s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG nova.network.neutron [req-77497ca8-4cc5-4d26-9497-89f592ae1a35 req-3c0c28e0-6da8-46f8-bad6-e66923ff1bfa service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Updated VIF entry in instance network info cache for port 7f9a086d-a7d3-4d59-80c2-e2db1415b5a7. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG nova.network.neutron [req-77497ca8-4cc5-4d26-9497-89f592ae1a35 req-3c0c28e0-6da8-46f8-bad6-e66923ff1bfa service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Updating instance_info_cache with network_info: [{"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-77497ca8-4cc5-4d26-9497-89f592ae1a35 req-3c0c28e0-6da8-46f8-bad6-e66923ff1bfa service nova] Releasing lock "refresh_cache-004ce11d-31dc-41dc-a5ac-b639c4c8486d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Skipping network cache update for instance because it is Building. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Skipping network cache update for instance because it is Building. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-31740b6d-af8a-4e9f-aadc-01b4261aa761 req-c7ef1416-f94c-41c8-b60d-37a47a0e1f9e service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received event network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31740b6d-af8a-4e9f-aadc-01b4261aa761 req-c7ef1416-f94c-41c8-b60d-37a47a0e1f9e service nova] Acquiring lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31740b6d-af8a-4e9f-aadc-01b4261aa761 req-c7ef1416-f94c-41c8-b60d-37a47a0e1f9e service nova] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31740b6d-af8a-4e9f-aadc-01b4261aa761 req-c7ef1416-f94c-41c8-b60d-37a47a0e1f9e service nova] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-31740b6d-af8a-4e9f-aadc-01b4261aa761 req-c7ef1416-f94c-41c8-b60d-37a47a0e1f9e service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] No waiting events found dispatching network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:39 user nova-compute[72178]: WARNING nova.compute.manager [req-31740b6d-af8a-4e9f-aadc-01b4261aa761 req-c7ef1416-f94c-41c8-b60d-37a47a0e1f9e service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received unexpected event network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 for instance with vm_state building and task_state spawning.
Aug 01 12:07:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updating instance_info_cache with network_info: [{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:07:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-44b91986-6d65-4384-976c-74cc244c1979 req-c79b1c19-1793-4033-9a28-ba00c0139a3b service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received event network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-44b91986-6d65-4384-976c-74cc244c1979 req-c79b1c19-1793-4033-9a28-ba00c0139a3b service nova] Acquiring lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-44b91986-6d65-4384-976c-74cc244c1979 req-c79b1c19-1793-4033-9a28-ba00c0139a3b service nova] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-44b91986-6d65-4384-976c-74cc244c1979 req-c79b1c19-1793-4033-9a28-ba00c0139a3b service nova] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-44b91986-6d65-4384-976c-74cc244c1979 req-c79b1c19-1793-4033-9a28-ba00c0139a3b service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] No waiting events found dispatching network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:41 user nova-compute[72178]: WARNING nova.compute.manager [req-44b91986-6d65-4384-976c-74cc244c1979 req-c79b1c19-1793-4033-9a28-ba00c0139a3b service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received unexpected event network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 for instance with vm_state building and task_state spawning.
Aug 01 12:07:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [{"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance network_info: |[{"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-995ee2e0-4d05-4310-941c-4ed0f3873adb req-ca2fce22-ab12-4d9d-9cb9-6a13d923ded7 service nova] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG nova.network.neutron [req-995ee2e0-4d05-4310-941c-4ed0f3873adb req-ca2fce22-ab12-4d9d-9cb9-6a13d923ded7 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing network info cache for port 77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891661.9585972, 004ce11d-31dc-41dc-a5ac-b639c4c8486d => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:07:41 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] VM Resumed (Lifecycle Event)
Aug 01 12:07:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:07:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:42 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Instance spawned successfully.
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:42 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891661.9590347, 004ce11d-31dc-41dc-a5ac-b639c4c8486d => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:07:42 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] VM Started (Lifecycle Event)
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:07:42 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.network.neutron [req-995ee2e0-4d05-4310-941c-4ed0f3873adb req-ca2fce22-ab12-4d9d-9cb9-6a13d923ded7 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updated VIF entry in instance network info cache for port 77ce169c-f4ed-4da4-895f-57f0f1505f56. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.network.neutron [req-995ee2e0-4d05-4310-941c-4ed0f3873adb req-ca2fce22-ab12-4d9d-9cb9-6a13d923ded7 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [{"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-995ee2e0-4d05-4310-941c-4ed0f3873adb req-ca2fce22-ab12-4d9d-9cb9-6a13d923ded7 service nova] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:42 user nova-compute[72178]: INFO nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Took 14.14 seconds to spawn the instance on the hypervisor.
Aug 01 12:07:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:42 user nova-compute[72178]: INFO nova.compute.manager [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Took 15.23 seconds to build instance.
Aug 01 12:07:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-63b8d169-93d4-4134-8f05-ceb354a691e6 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.351s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:43 user nova-compute[72178]: INFO nova.compute.manager [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Terminating instance
Aug 01 12:07:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-f88a5c63-6de7-4c9a-b053-d4a832ac166c req-c54eb8e4-252e-4781-a835-c8b2c1399f54 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f88a5c63-6de7-4c9a-b053-d4a832ac166c req-c54eb8e4-252e-4781-a835-c8b2c1399f54 service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f88a5c63-6de7-4c9a-b053-d4a832ac166c req-c54eb8e4-252e-4781-a835-c8b2c1399f54 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f88a5c63-6de7-4c9a-b053-d4a832ac166c req-c54eb8e4-252e-4781-a835-c8b2c1399f54 service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-f88a5c63-6de7-4c9a-b053-d4a832ac166c req-c54eb8e4-252e-4781-a835-c8b2c1399f54 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-f88a5c63-6de7-4c9a-b053-d4a832ac166c req-c54eb8e4-252e-4781-a835-c8b2c1399f54 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-unplugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:07:44 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Instance destroyed successfully.
Aug 01 12:07:44 user nova-compute[72178]: DEBUG nova.objects.instance [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lazy-loading 'resources' on Instance uuid f75a07e7-7cd8-4a63-b03d-422e07da25f8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1304452031',display_name='tempest-ServerActionsTestOtherB-server-1304452031',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1304452031',id=8,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7je/gDd6PmK1BL29WescWaK5xqPQC3OOGnzsYe73th/Ed45V+4GxD9pgPFh4Te1+cO0eSDDSyxMgicoXZIKYAQf/l6yqIpv3oSBj3rwn/wysP6tVx+EhGPIRa7XB4NeA==',key_name='tempest-keypair-526213853',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:05:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b58e90c2bb974b6a9be977ac0ce46828',ramdisk_id='',reservation_id='r-209wchs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2113691896',owner_user_name='tempest-ServerActionsTestOtherB-2113691896-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:05:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57295306c0f44b0db27c9eb0c3ac8b6b',uuid=f75a07e7-7cd8-4a63-b03d-422e07da25f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converting VIF {"id": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "address": "fa:16:3e:3b:c9:93", "network": {"id": "df63a99e-71f7-490c-8353-052e1103aec6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-648870079-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b58e90c2bb974b6a9be977ac0ce46828", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f9f171c-75", "ovs_interfaceid": "5f9f171c-75e5-4362-8075-9051f6fbcabe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_vif [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f9f171c-75, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:44 user nova-compute[72178]: INFO os_vif [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:c9:93,bridge_name='br-int',has_traffic_filtering=True,id=5f9f171c-75e5-4362-8075-9051f6fbcabe,network=Network(df63a99e-71f7-490c-8353-052e1103aec6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f9f171c-75')
Aug 01 12:07:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKRJbqnS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:44 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb2cd75-c2cd-44d2-9477-1d2f1e062520]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e5a91a-d2ee-4bdb-9cb9-3ab23cdd11ac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:44 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:07:44 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:44 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:44 user nova-compute[72178]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 (non-flash)
Aug 01 12:07:44 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:44 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f421d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4554d6c2-7324-4220-9224-08653d6a0561]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c8395-954d-4ac8-9c09-c928f81d5e67]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5eb9ba-e010-4ee5-9c6e-cacd92d708a3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee609184-7bf1-4211-85b9-1a19ea9dff51]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cd9052-f4fa-4252-b15d-3687dd1cde4e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c911a75-2bde-40dd-94a0-a25fb57ded7c]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260]
Aug 01 12:07:45 user nova-compute[72178]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625, portal: 172.16.0.220,3260] successful.
Aug 01 12:07:45 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06acd6f-2445-445a-98b0-a6811ac35625 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28cb8c4-040e-4b90-bae7-1bb96d7f385c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] <== disconnect_volume: return (441ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:07:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Deleting instance files /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8_del
Aug 01 12:07:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Deletion of /opt/stack/data/nova/instances/f75a07e7-7cd8-4a63-b03d-422e07da25f8_del complete
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:07:45 user nova-compute[72178]: INFO nova.compute.manager [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:07:45 user nova-compute[72178]: INFO nova.compute.claims [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Claim successful on node user
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.776s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:07:46 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:07:46 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Creating image(s)
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Ensure instance console log exists: /opt/stack/data/nova/instances/65e21777-de00-4f0a-9774-c1305ac68a43/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Start _get_guest_xml network_info=[{"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noulMdtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65e21777-de00-4f0a-9774-c1305ac68a43', 'attached_at': '', 'detached_at': '', 'volume_id': '046fadda-0003-4747-929b-4c5215e18c4b', 'serial': '046fadda-0003-4747-929b-4c5215e18c4b'}, 'boot_index': 0, 'attachment_id': '0f4dc66e-7144-4955-91d8-14e1d9f0e041', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFzeJKIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65e21777-de00-4f0a-9774-c1305ac68a43', 'attached_at': '', 'detached_at': '', 'volume_id': '4f17261c-e322-48ac-be2c-700108c830a8', 'serial': '4f17261c-e322-48ac-be2c-700108c830a8'}, 'boot_index': 1, 'attachment_id': '5851b159-feaf-4c24-ae21-1ce834a974aa', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None}, {'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSNkwuxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '65e21777-de00-4f0a-9774-c1305ac68a43', 'attached_at': '', 'detached_at': '', 'volume_id': 'e73d7de4-10a9-4fc8-a9c8-3ee966218124', 'serial': 'e73d7de4-10a9-4fc8-a9c8-3ee966218124'}, 'boot_index': 2, 'attachment_id': '4df33ba8-dc6d-4124-b82a-fb62939d0038', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:07:46 user nova-compute[72178]: INFO nova.virt.block_device [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Booting with volume 1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 at /dev/vda
Aug 01 12:07:46 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:46 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noulMdtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:46 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:46 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:46 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.policy [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5bc4265e5e5a4c50b76f755a048af7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4c619872deb42eca689576a995b252e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.utils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-a8ef15dd-2d9b-44f7-9fa3-9dfd906608da req-cafcb7d8-658d-488c-ad16-9568bfcecf8b service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a8ef15dd-2d9b-44f7-9fa3-9dfd906608da req-cafcb7d8-658d-488c-ad16-9568bfcecf8b service nova] Acquiring lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a8ef15dd-2d9b-44f7-9fa3-9dfd906608da req-cafcb7d8-658d-488c-ad16-9568bfcecf8b service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a8ef15dd-2d9b-44f7-9fa3-9dfd906608da req-cafcb7d8-658d-488c-ad16-9568bfcecf8b service nova] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-a8ef15dd-2d9b-44f7-9fa3-9dfd906608da req-cafcb7d8-658d-488c-ad16-9568bfcecf8b service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] No waiting events found dispatching network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:46 user nova-compute[72178]: WARNING nova.compute.manager [req-a8ef15dd-2d9b-44f7-9fa3-9dfd906608da req-cafcb7d8-658d-488c-ad16-9568bfcecf8b service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received unexpected event network-vif-plugged-5f9f171c-75e5-4362-8075-9051f6fbcabe for instance with vm_state active and task_state deleting.
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a130cab-ce41-479a-ac83-ceb3a1d80188]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:07:46 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3641ecbf-258b-489c-8cb4-bd8afb2bfd7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Took 1.22 seconds to deallocate network for instance.
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-8b41adab-9c44-40b3-9dad-198df98236db req-65688bc4-740a-485b-9dbb-d9a8d926bbb0 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Received event network-vif-deleted-5f9f171c-75e5-4362-8075-9051f6fbcabe {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:46 user nova-compute[72178]: INFO nova.compute.manager [req-8b41adab-9c44-40b3-9dad-198df98236db req-65688bc4-740a-485b-9dbb-d9a8d926bbb0 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Neutron deleted interface 5f9f171c-75e5-4362-8075-9051f6fbcabe; detaching it from the instance and deleting it from the info cache
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.network.neutron [req-8b41adab-9c44-40b3-9dad-198df98236db req-65688bc4-740a-485b-9dbb-d9a8d926bbb0 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[19602478-8bba-44d4-bcb5-e834c37093c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d017e1-a394-4d86-b2af-bdaa64f5fb69]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b] added
Aug 01 12:07:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-8b41adab-9c44-40b3-9dad-198df98236db req-65688bc4-740a-485b-9dbb-d9a8d926bbb0 service nova] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Detach interface failed, port_id=5f9f171c-75e5-4362-8075-9051f6fbcabe, reason: Instance f75a07e7-7cd8-4a63-b03d-422e07da25f8 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[212a999c-53c1-462e-b899-ec69b21c9ecf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce06001-272e-486e-a3d2-87d3bcde6b97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22957d6-75d9-4804-997c-0ee2bc5ce720]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:07:46 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fd637c-cfc2-4677-9a5a-0a6445e4ea3a]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbb215a-fcb9-4943-8636-950164ec4cb3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.utils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating existing volume attachment record: e1436d52-0a8e-496e-837c-86b8510ab5d5 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v noulMdtC {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v noulMdtC" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5d6aeb-4585-48a5-955a-185cbcd4fbc7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'noulMdtC'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[15898fed-c830-4b39-9c23-a7dc1233976f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a5fb9-e065-4b1d-8905-2e8e0b41c262]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:46 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:46 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[97af26d9-fa15-434d-8240-2a7df51b9a68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b, portal: 172.16.0.220,3260]
Aug 01 12:07:46 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b, portal: 172.16.0.220,3260] successful.
Aug 01 12:07:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.225s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b69f7-70d5-443b-9e68-a5638112e837]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b63a27-80cb-4ebf-8970-76146fb64a7b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:47 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:47 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:47 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:47 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.680s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.117s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fd07af-a939-4804-981d-1e3850e7190e]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noulMdtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:07:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:48 user nova-compute[72178]: INFO nova.compute.manager [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Took 1.52 seconds to detach 1 volumes for instance.
Aug 01 12:07:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Successfully created port: 29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.990s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== connect_volume: return (1991ms) {'type': 'block', 'scsi_wwn': '23264366538363636', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264366538363636', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFzeJKIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:48 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:48 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:48 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e541e-2ff5-421f-9706-29ac941c2842]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:07:48 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd536dad-8c9a-4476-8313-1a8eaaed81c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8] added
Aug 01 12:07:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac97946c-cc48-4c93-a03f-98e39717c0a2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac7556a-a7f6-4f4c-a08f-dc476628e04c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFzeJKIG {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wFzeJKIG" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a93c3-6b6c-4fd1-929c-a3e19032a932]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wFzeJKIG'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a8bf9f-ef61-4ab8-8fab-30c513f32f59]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a728f55-1a3b-42ec-ab4e-d3b86f380f61]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa71c573-a2b2-4a70-988d-bc093fb6dbe2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8, portal: 172.16.0.220,3260]
Aug 01 12:07:48 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8, portal: 172.16.0.220,3260] successful.
Aug 01 12:07:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.746s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[779a6bde-8686-4b26-b59d-58599b8d55c5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b87f460-0f2a-41da-8faf-6c7b9db680de]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:48 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:48 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:48 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Deleted allocations for instance f75a07e7-7cd8-4a63-b03d-422e07da25f8
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe45abb-7b74-4b2a-bf53-fbfe963ed4ff]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:07:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFzeJKIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c89790c-8b9f-4921-910d-8fda682531dc tempest-ServerActionsTestOtherB-2113691896 tempest-ServerActionsTestOtherB-2113691896-project-member] Lock "f75a07e7-7cd8-4a63-b03d-422e07da25f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.309s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Successfully updated port: 29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquired lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-d041610a-6ab3-4f70-bf06-d76a25e3658b req-6c280a3b-4562-435c-962b-7808f0d0fa1f service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-changed-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-d041610a-6ab3-4f70-bf06-d76a25e3658b req-6c280a3b-4562-435c-962b-7808f0d0fa1f service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Refreshing instance network info cache due to event network-changed-29efbfad-3acd-4d72-977a-776ed80c3b47. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d041610a-6ab3-4f70-bf06-d76a25e3658b req-6c280a3b-4562-435c-962b-7808f0d0fa1f service nova] Acquiring lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating instance_info_cache with network_info: [{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Releasing lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance network_info: |[{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d041610a-6ab3-4f70-bf06-d76a25e3658b req-6c280a3b-4562-435c-962b-7808f0d0fa1f service nova] Acquired lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.network.neutron [req-d041610a-6ab3-4f70-bf06-d76a25e3658b req-6c280a3b-4562-435c-962b-7808f0d0fa1f service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Refreshing network info cache for port 29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.454s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== connect_volume: return (1456ms) {'type': 'block', 'scsi_wwn': '23464613530346535', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464613530346535', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSNkwuxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:49 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:49 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:49 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d19dbc5-9eb4-41fb-a20e-40e10012f660]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:07:49 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a51874-1e31-460f-b92c-d9a76837470d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124] added
Aug 01 12:07:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf09087-acd0-4766-bb38-cb84a9f3e995]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[970c5f0d-d94f-41b7-910a-5a260ee7ea4d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSNkwuxg {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSNkwuxg" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4688d49-f4d8-4253-9481-ef8ef1afe32b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jSNkwuxg'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-d041610a-6ab3-4f70-bf06-d76a25e3658b req-6c280a3b-4562-435c-962b-7808f0d0fa1f service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updated VIF entry in instance network info cache for port 29efbfad-3acd-4d72-977a-776ed80c3b47. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-d041610a-6ab3-4f70-bf06-d76a25e3658b req-6c280a3b-4562-435c-962b-7808f0d0fa1f service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating instance_info_cache with network_info: [{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba35575-cd29-42e6-a0c1-50bdd98f3b27]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d041610a-6ab3-4f70-bf06-d76a25e3658b req-6c280a3b-4562-435c-962b-7808f0d0fa1f service nova] Releasing lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd07bc-3d63-45b5-b464-4da7c3d72593]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae61baa8-a9f6-44d8-be0d-6d175e37fea4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124, portal: 172.16.0.220,3260]
Aug 01 12:07:50 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124, portal: 172.16.0.220,3260] successful.
Aug 01 12:07:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c44d9-4920-4d80-a48b-2187d70887ad]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab8ca6-c409-4587-b813-645ec6d92d4d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:07:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:50 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:07:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ccb07-d7a4-4b93-a42f-01835f4b3714]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:07:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSNkwuxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23966356436383735', 'path': '/dev/sdf'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966356436383735', 'path': '/dev/sdf'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:47:d9,bridge_name='br-int',has_traffic_filtering=True,id=0222d3a2-c922-4175-b9d9-9962d26eeda7,network=Network(0135f2c9-2257-4989-add4-bc538ffaf5d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0222d3a2-c9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:49:87,bridge_name='br-int',has_traffic_filtering=True,id=c11d9dd2-2202-4030-83a5-1dbbb3cfe72c,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc11d9dd2-22') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0654efa4-1f8e-45f5-85fb-07d2749de7d8,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0654efa4-1f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:02:59,bridge_name='br-int',has_traffic_filtering=True,id=eeb93cf4-bb8f-4d36-8bd7-8f6211b18396,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb93cf4-bb') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=38efafbc-6dde-4d99-9210-7231eac9baec,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38efafbc-6d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e4:65,bridge_name='br-int',has_traffic_filtering=True,id=10b42e49-0aec-4c43-8007-a256bd95956a,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b42e49-0a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:22:66,bridge_name='br-int',has_traffic_filtering=True,id=77ce169c-f4ed-4da4-895f-57f0f1505f56,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ce169c-f4') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lazy-loading 'pci_devices' on Instance uuid 65e21777-de00-4f0a-9774-c1305ac68a43 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:07:51 user nova-compute[72178]:   <uuid>65e21777-de00-4f0a-9774-c1305ac68a43</uuid>
Aug 01 12:07:51 user nova-compute[72178]:   <name>instance-00000016</name>
Aug 01 12:07:51 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:07:51 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:07:51 user nova-compute[72178]:   <metadata>
Aug 01 12:07:51 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:07:51 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:07:51 user nova-compute[72178]:       <nova:name>tempest-device-tagging-server-592278091</nova:name>
Aug 01 12:07:51 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:07:46</nova:creationTime>
Aug 01 12:07:51 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:07:51 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:07:51 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:07:51 user nova-compute[72178]:       <nova:owner>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:user uuid="f716d894c2dc4c6b8c73bbb26c8423be">tempest-TaggedBootDevicesTest_v242-437439604-project-member</nova:user>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:project uuid="772835a74e894918b57dc09ea4aa50f2">tempest-TaggedBootDevicesTest_v242-437439604</nova:project>
Aug 01 12:07:51 user nova-compute[72178]:       </nova:owner>
Aug 01 12:07:51 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:07:51 user nova-compute[72178]:       <nova:ports>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:port uuid="0222d3a2-c922-4175-b9d9-9962d26eeda7">
Aug 01 12:07:51 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 12:07:51 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:port uuid="c11d9dd2-2202-4030-83a5-1dbbb3cfe72c">
Aug 01 12:07:51 user nova-compute[72178]:           <nova:ip type="fixed" address="10.1.1.81" ipVersion="4"/>
Aug 01 12:07:51 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:port uuid="0654efa4-1f8e-45f5-85fb-07d2749de7d8">
Aug 01 12:07:51 user nova-compute[72178]:           <nova:ip type="fixed" address="10.1.1.188" ipVersion="4"/>
Aug 01 12:07:51 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:port uuid="eeb93cf4-bb8f-4d36-8bd7-8f6211b18396">
Aug 01 12:07:51 user nova-compute[72178]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Aug 01 12:07:51 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:port uuid="38efafbc-6dde-4d99-9210-7231eac9baec">
Aug 01 12:07:51 user nova-compute[72178]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Aug 01 12:07:51 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:port uuid="10b42e49-0aec-4c43-8007-a256bd95956a">
Aug 01 12:07:51 user nova-compute[72178]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 01 12:07:51 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:51 user nova-compute[72178]:         <nova:port uuid="77ce169c-f4ed-4da4-895f-57f0f1505f56">
Aug 01 12:07:51 user nova-compute[72178]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 01 12:07:51 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:51 user nova-compute[72178]:       </nova:ports>
Aug 01 12:07:51 user nova-compute[72178]:     </nova:instance>
Aug 01 12:07:51 user nova-compute[72178]:   </metadata>
Aug 01 12:07:51 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:07:51 user nova-compute[72178]:     <system>
Aug 01 12:07:51 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:07:51 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:07:51 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:07:51 user nova-compute[72178]:       <entry name="serial">65e21777-de00-4f0a-9774-c1305ac68a43</entry>
Aug 01 12:07:51 user nova-compute[72178]:       <entry name="uuid">65e21777-de00-4f0a-9774-c1305ac68a43</entry>
Aug 01 12:07:51 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:07:51 user nova-compute[72178]:     </system>
Aug 01 12:07:51 user nova-compute[72178]:   </sysinfo>
Aug 01 12:07:51 user nova-compute[72178]:   <os>
Aug 01 12:07:51 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:07:51 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:07:51 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:07:51 user nova-compute[72178]:   </os>
Aug 01 12:07:51 user nova-compute[72178]:   <features>
Aug 01 12:07:51 user nova-compute[72178]:     <acpi/>
Aug 01 12:07:51 user nova-compute[72178]:     <apic/>
Aug 01 12:07:51 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:07:51 user nova-compute[72178]:   </features>
Aug 01 12:07:51 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:07:51 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:07:51 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:07:51 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:07:51 user nova-compute[72178]:   </clock>
Aug 01 12:07:51 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:07:51 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:07:51 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:07:51 user nova-compute[72178]:   </cpu>
Aug 01 12:07:51 user nova-compute[72178]:   <devices>
Aug 01 12:07:51 user nova-compute[72178]:     <disk type="file" device="cdrom">
Aug 01 12:07:51 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none"/>
Aug 01 12:07:51 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/65e21777-de00-4f0a-9774-c1305ac68a43/disk.config"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="hda" bus="ide"/>
Aug 01 12:07:51 user nova-compute[72178]:     </disk>
Aug 01 12:07:51 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:07:51 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:07:51 user nova-compute[72178]:       <source dev="/dev/sdd"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <serial>046fadda-0003-4747-929b-4c5215e18c4b</serial>
Aug 01 12:07:51 user nova-compute[72178]:     </disk>
Aug 01 12:07:51 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:07:51 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:07:51 user nova-compute[72178]:       <source dev="/dev/sde"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <serial>4f17261c-e322-48ac-be2c-700108c830a8</serial>
Aug 01 12:07:51 user nova-compute[72178]:     </disk>
Aug 01 12:07:51 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:07:51 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:07:51 user nova-compute[72178]:       <source dev="/dev/sdf"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="vdc" bus="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <serial>e73d7de4-10a9-4fc8-a9c8-3ee966218124</serial>
Aug 01 12:07:51 user nova-compute[72178]:     </disk>
Aug 01 12:07:51 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:51 user nova-compute[72178]:       <mac address="fa:16:3e:79:47:d9"/>
Aug 01 12:07:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="tap0222d3a2-c9"/>
Aug 01 12:07:51 user nova-compute[72178]:     </interface>
Aug 01 12:07:51 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:51 user nova-compute[72178]:       <mac address="fa:16:3e:8f:49:87"/>
Aug 01 12:07:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="tapc11d9dd2-22"/>
Aug 01 12:07:51 user nova-compute[72178]:     </interface>
Aug 01 12:07:51 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:51 user nova-compute[72178]:       <mac address="fa:16:3e:1f:03:f0"/>
Aug 01 12:07:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="tap0654efa4-1f"/>
Aug 01 12:07:51 user nova-compute[72178]:     </interface>
Aug 01 12:07:51 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:51 user nova-compute[72178]:       <mac address="fa:16:3e:33:02:59"/>
Aug 01 12:07:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="tapeeb93cf4-bb"/>
Aug 01 12:07:51 user nova-compute[72178]:     </interface>
Aug 01 12:07:51 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:51 user nova-compute[72178]:       <mac address="fa:16:3e:87:33:c2"/>
Aug 01 12:07:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="tap38efafbc-6d"/>
Aug 01 12:07:51 user nova-compute[72178]:     </interface>
Aug 01 12:07:51 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:51 user nova-compute[72178]:       <mac address="fa:16:3e:bb:e4:65"/>
Aug 01 12:07:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="tap10b42e49-0a"/>
Aug 01 12:07:51 user nova-compute[72178]:     </interface>
Aug 01 12:07:51 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:51 user nova-compute[72178]:       <mac address="fa:16:3e:6c:22:66"/>
Aug 01 12:07:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:51 user nova-compute[72178]:       <target dev="tap77ce169c-f4"/>
Aug 01 12:07:51 user nova-compute[72178]:     </interface>
Aug 01 12:07:51 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:07:51 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/65e21777-de00-4f0a-9774-c1305ac68a43/console.log" append="off"/>
Aug 01 12:07:51 user nova-compute[72178]:     </serial>
Aug 01 12:07:51 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:07:51 user nova-compute[72178]:     <video>
Aug 01 12:07:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:51 user nova-compute[72178]:     </video>
Aug 01 12:07:51 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:07:51 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:07:51 user nova-compute[72178]:     </rng>
Aug 01 12:07:51 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:07:51 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:07:51 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:07:51 user nova-compute[72178]:     </memballoon>
Aug 01 12:07:51 user nova-compute[72178]:   </devices>
Aug 01 12:07:51 user nova-compute[72178]: </domain>
Aug 01 12:07:51 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:47:d9,bridge_name='br-int',has_traffic_filtering=True,id=0222d3a2-c922-4175-b9d9-9962d26eeda7,network=Network(0135f2c9-2257-4989-add4-bc538ffaf5d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0222d3a2-c9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:47:d9,bridge_name='br-int',has_traffic_filtering=True,id=0222d3a2-c922-4175-b9d9-9962d26eeda7,network=Network(0135f2c9-2257-4989-add4-bc538ffaf5d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0222d3a2-c9') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0222d3a2-c9, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0222d3a2-c9, col_values=(('external_ids', {'iface-id': '0222d3a2-c922-4175-b9d9-9962d26eeda7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:47:d9', 'vm-uuid': '65e21777-de00-4f0a-9774-c1305ac68a43'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: INFO os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:47:d9,bridge_name='br-int',has_traffic_filtering=True,id=0222d3a2-c922-4175-b9d9-9962d26eeda7,network=Network(0135f2c9-2257-4989-add4-bc538ffaf5d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0222d3a2-c9')
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:49:87,bridge_name='br-int',has_traffic_filtering=True,id=c11d9dd2-2202-4030-83a5-1dbbb3cfe72c,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc11d9dd2-22') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:49:87,bridge_name='br-int',has_traffic_filtering=True,id=c11d9dd2-2202-4030-83a5-1dbbb3cfe72c,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc11d9dd2-22') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc11d9dd2-22, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc11d9dd2-22, col_values=(('external_ids', {'iface-id': 'c11d9dd2-2202-4030-83a5-1dbbb3cfe72c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:49:87', 'vm-uuid': '65e21777-de00-4f0a-9774-c1305ac68a43'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: INFO os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:49:87,bridge_name='br-int',has_traffic_filtering=True,id=c11d9dd2-2202-4030-83a5-1dbbb3cfe72c,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc11d9dd2-22')
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0654efa4-1f8e-45f5-85fb-07d2749de7d8,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0654efa4-1f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0654efa4-1f8e-45f5-85fb-07d2749de7d8,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0654efa4-1f') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0654efa4-1f, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0654efa4-1f, col_values=(('external_ids', {'iface-id': '0654efa4-1f8e-45f5-85fb-07d2749de7d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:03:f0', 'vm-uuid': '65e21777-de00-4f0a-9774-c1305ac68a43'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: INFO os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0654efa4-1f8e-45f5-85fb-07d2749de7d8,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0654efa4-1f')
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:02:59,bridge_name='br-int',has_traffic_filtering=True,id=eeb93cf4-bb8f-4d36-8bd7-8f6211b18396,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb93cf4-bb') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:02:59,bridge_name='br-int',has_traffic_filtering=True,id=eeb93cf4-bb8f-4d36-8bd7-8f6211b18396,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb93cf4-bb') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb93cf4-bb, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeb93cf4-bb, col_values=(('external_ids', {'iface-id': 'eeb93cf4-bb8f-4d36-8bd7-8f6211b18396', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:02:59', 'vm-uuid': '65e21777-de00-4f0a-9774-c1305ac68a43'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: INFO os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:02:59,bridge_name='br-int',has_traffic_filtering=True,id=eeb93cf4-bb8f-4d36-8bd7-8f6211b18396,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb93cf4-bb')
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=38efafbc-6dde-4d99-9210-7231eac9baec,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38efafbc-6d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=38efafbc-6dde-4d99-9210-7231eac9baec,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38efafbc-6d') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38efafbc-6d, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38efafbc-6d, col_values=(('external_ids', {'iface-id': '38efafbc-6dde-4d99-9210-7231eac9baec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:33:c2', 'vm-uuid': '65e21777-de00-4f0a-9774-c1305ac68a43'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: INFO os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=38efafbc-6dde-4d99-9210-7231eac9baec,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38efafbc-6d')
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e4:65,bridge_name='br-int',has_traffic_filtering=True,id=10b42e49-0aec-4c43-8007-a256bd95956a,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b42e49-0a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e4:65,bridge_name='br-int',has_traffic_filtering=True,id=10b42e49-0aec-4c43-8007-a256bd95956a,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b42e49-0a') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10b42e49-0a, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10b42e49-0a, col_values=(('external_ids', {'iface-id': '10b42e49-0aec-4c43-8007-a256bd95956a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:e4:65', 'vm-uuid': '65e21777-de00-4f0a-9774-c1305ac68a43'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: INFO os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e4:65,bridge_name='br-int',has_traffic_filtering=True,id=10b42e49-0aec-4c43-8007-a256bd95956a,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b42e49-0a')
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:22:66,bridge_name='br-int',has_traffic_filtering=True,id=77ce169c-f4ed-4da4-895f-57f0f1505f56,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ce169c-f4') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:22:66,bridge_name='br-int',has_traffic_filtering=True,id=77ce169c-f4ed-4da4-895f-57f0f1505f56,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ce169c-f4') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77ce169c-f4, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77ce169c-f4, col_values=(('external_ids', {'iface-id': '77ce169c-f4ed-4da4-895f-57f0f1505f56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:22:66', 'vm-uuid': '65e21777-de00-4f0a-9774-c1305ac68a43'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:51 user nova-compute[72178]: INFO os_vif [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:22:66,bridge_name='br-int',has_traffic_filtering=True,id=77ce169c-f4ed-4da4-895f-57f0f1505f56,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ce169c-f4')
Aug 01 12:07:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] No BDM found with device name hda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:07:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:07:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] No VIF found with MAC fa:16:3e:79:47:d9, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:07:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] No VIF found with MAC fa:16:3e:87:33:c2, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:07:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Using config drive
Aug 01 12:07:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Creating config drive at /opt/stack/data/nova/instances/65e21777-de00-4f0a-9774-c1305ac68a43/disk.config
Aug 01 12:07:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/65e21777-de00-4f0a-9774-c1305ac68a43/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_b7vqfqq {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/65e21777-de00-4f0a-9774-c1305ac68a43/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_b7vqfqq" returned: 0 in 0.077s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-5ca066f2-2ef6-4076-aee1-10e3d88e75a8 req-99bede12-1f60-44fc-92f5-c5a8073aa909 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ca066f2-2ef6-4076-aee1-10e3d88e75a8 req-99bede12-1f60-44fc-92f5-c5a8073aa909 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ca066f2-2ef6-4076-aee1-10e3d88e75a8 req-99bede12-1f60-44fc-92f5-c5a8073aa909 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ca066f2-2ef6-4076-aee1-10e3d88e75a8 req-99bede12-1f60-44fc-92f5-c5a8073aa909 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-5ca066f2-2ef6-4076-aee1-10e3d88e75a8 req-99bede12-1f60-44fc-92f5-c5a8073aa909 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:54 user nova-compute[72178]: WARNING nova.compute.manager [req-5ca066f2-2ef6-4076-aee1-10e3d88e75a8 req-99bede12-1f60-44fc-92f5-c5a8073aa909 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 for instance with vm_state building and task_state spawning.
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-e9c79a84-ca72-4db8-a83e-1f24278c00a9 req-7d9d4abf-6d2c-445b-b829-bc2a9744e429 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e9c79a84-ca72-4db8-a83e-1f24278c00a9 req-7d9d4abf-6d2c-445b-b829-bc2a9744e429 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e9c79a84-ca72-4db8-a83e-1f24278c00a9 req-7d9d4abf-6d2c-445b-b829-bc2a9744e429 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e9c79a84-ca72-4db8-a83e-1f24278c00a9 req-7d9d4abf-6d2c-445b-b829-bc2a9744e429 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-e9c79a84-ca72-4db8-a83e-1f24278c00a9 req-7d9d4abf-6d2c-445b-b829-bc2a9744e429 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:55 user nova-compute[72178]: WARNING nova.compute.manager [req-e9c79a84-ca72-4db8-a83e-1f24278c00a9 req-7d9d4abf-6d2c-445b-b829-bc2a9744e429 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 for instance with vm_state building and task_state spawning.
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-ff5d95ad-ff6f-4ed3-83b7-469282be41c9 req-1c461488-acad-4a42-995c-155fb1a48cbc service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff5d95ad-ff6f-4ed3-83b7-469282be41c9 req-1c461488-acad-4a42-995c-155fb1a48cbc service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff5d95ad-ff6f-4ed3-83b7-469282be41c9 req-1c461488-acad-4a42-995c-155fb1a48cbc service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff5d95ad-ff6f-4ed3-83b7-469282be41c9 req-1c461488-acad-4a42-995c-155fb1a48cbc service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-ff5d95ad-ff6f-4ed3-83b7-469282be41c9 req-1c461488-acad-4a42-995c-155fb1a48cbc service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:55 user nova-compute[72178]: WARNING nova.compute.manager [req-ff5d95ad-ff6f-4ed3-83b7-469282be41c9 req-1c461488-acad-4a42-995c-155fb1a48cbc service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 for instance with vm_state building and task_state spawning.
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:56 user nova-compute[72178]: WARNING nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 for instance with vm_state building and task_state spawning.
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:56 user nova-compute[72178]: WARNING nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c for instance with vm_state building and task_state spawning.
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:56 user nova-compute[72178]: WARNING nova.compute.manager [req-ff138abc-93a2-4bca-bd5b-3312406ab086 req-124eecac-d37a-45eb-8e61-6b5bd054652f service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c for instance with vm_state building and task_state spawning.
Aug 01 12:07:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:07:56 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Creating image(s)
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Ensure instance console log exists: /opt/stack/data/nova/instances/e7e1d3fe-99fe-41fe-bff7-5ea191c529de/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Start _get_guest_xml network_info=[{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXWOLGuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7e1d3fe-99fe-41fe-bff7-5ea191c529de', 'attached_at': '', 'detached_at': '', 'volume_id': '1aaa80a6-89bc-4172-bdd7-6f6ab3e17987', 'serial': '1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'}, 'boot_index': 0, 'attachment_id': 'e1436d52-0a8e-496e-837c-86b8510ab5d5', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:07:56 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:56 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXWOLGuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:07:56 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:56 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:07:56 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:07:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dfd574-63cd-439a-bd56-26a977feee0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:07:56 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3236273-cccc-4fd5-8c9f-eadc4a8210dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987] added
Aug 01 12:07:56 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d75df-513c-4655-95c4-4a74aa3fa2e7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[267f2d62-b5b3-48d4-8556-5cd21906620d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXWOLGuf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXWOLGuf" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139ffbb-76f2-4f84-86f1-2c5a6ecc8eaa]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXWOLGuf'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eae28a-a167-4cb7-9e03-ff63359397e6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c979935-8dc8-4293-a772-4b7b399fc650]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7214d4c4-e1b5-4eb5-8453-d41f3df601c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260]
Aug 01 12:07:57 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260] successful.
Aug 01 12:07:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c722b39c-fd1a-4e9c-95fb-4f653fc45cd0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68fff18-3052-4c2b-a2f4-1b3a028d6160]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:07:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:57 user nova-compute[72178]: WARNING nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 for instance with vm_state building and task_state spawning.
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:57 user nova-compute[72178]: WARNING nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec for instance with vm_state building and task_state spawning.
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:57 user nova-compute[72178]: WARNING nova.compute.manager [req-b8205883-5323-4ef6-a1a4-81798aca9887 req-0e13374e-a4c1-4b99-93d0-4e9b495a7d92 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec for instance with vm_state building and task_state spawning.
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[784073fb-16fb-4729-81c7-7b5699d70705]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXWOLGuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:57 user nova-compute[72178]: WARNING nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 for instance with vm_state building and task_state spawning.
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:57 user nova-compute[72178]: WARNING nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a for instance with vm_state building and task_state spawning.
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:57 user nova-compute[72178]: WARNING nova.compute.manager [req-8ac75b0e-4804-49e2-89e7-acd9193accc1 req-f0c59837-b1ee-48b7-b1c4-c2319c1ae359 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a for instance with vm_state building and task_state spawning.
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:07:57 user nova-compute[72178]: INFO nova.compute.claims [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Claim successful on node user
Aug 01 12:07:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:58 user nova-compute[72178]: WARNING nova.compute.manager [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 for instance with vm_state building and task_state spawning.
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:07:58 user nova-compute[72178]: WARNING nova.compute.manager [req-7cb7de41-44a9-4232-a74f-a44215e3c06a req-5ce65561-33ee-4195-98a9-5044ad35e2f5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 for instance with vm_state building and task_state spawning.
Aug 01 12:07:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26334376434653335', 'path': '/dev/sdg'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334376434653335', 'path': '/dev/sdg'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83603559',display_name='tempest-ServerActionsTestOtherA-server-83603559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83603559',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-4nops17y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=e7e1d3fe-99fe-41fe-bff7-5ea191c529de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'pci_devices' on Instance uuid e7e1d3fe-99fe-41fe-bff7-5ea191c529de {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:07:58 user nova-compute[72178]:   <uuid>e7e1d3fe-99fe-41fe-bff7-5ea191c529de</uuid>
Aug 01 12:07:58 user nova-compute[72178]:   <name>instance-00000019</name>
Aug 01 12:07:58 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:07:58 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:07:58 user nova-compute[72178]:   <metadata>
Aug 01 12:07:58 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:07:58 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:07:58 user nova-compute[72178]:       <nova:name>tempest-ServerActionsTestOtherA-server-83603559</nova:name>
Aug 01 12:07:58 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:07:56</nova:creationTime>
Aug 01 12:07:58 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:07:58 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:07:58 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:07:58 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:07:58 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:07:58 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:07:58 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:07:58 user nova-compute[72178]:       <nova:owner>
Aug 01 12:07:58 user nova-compute[72178]:         <nova:user uuid="5bc4265e5e5a4c50b76f755a048af7b4">tempest-ServerActionsTestOtherA-709464081-project-member</nova:user>
Aug 01 12:07:58 user nova-compute[72178]:         <nova:project uuid="c4c619872deb42eca689576a995b252e">tempest-ServerActionsTestOtherA-709464081</nova:project>
Aug 01 12:07:58 user nova-compute[72178]:       </nova:owner>
Aug 01 12:07:58 user nova-compute[72178]:       <nova:ports>
Aug 01 12:07:58 user nova-compute[72178]:         <nova:port uuid="29efbfad-3acd-4d72-977a-776ed80c3b47">
Aug 01 12:07:58 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 12:07:58 user nova-compute[72178]:         </nova:port>
Aug 01 12:07:58 user nova-compute[72178]:       </nova:ports>
Aug 01 12:07:58 user nova-compute[72178]:     </nova:instance>
Aug 01 12:07:58 user nova-compute[72178]:   </metadata>
Aug 01 12:07:58 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:07:58 user nova-compute[72178]:     <system>
Aug 01 12:07:58 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:07:58 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:07:58 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:07:58 user nova-compute[72178]:       <entry name="serial">e7e1d3fe-99fe-41fe-bff7-5ea191c529de</entry>
Aug 01 12:07:58 user nova-compute[72178]:       <entry name="uuid">e7e1d3fe-99fe-41fe-bff7-5ea191c529de</entry>
Aug 01 12:07:58 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:07:58 user nova-compute[72178]:     </system>
Aug 01 12:07:58 user nova-compute[72178]:   </sysinfo>
Aug 01 12:07:58 user nova-compute[72178]:   <os>
Aug 01 12:07:58 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:07:58 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:07:58 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:07:58 user nova-compute[72178]:   </os>
Aug 01 12:07:58 user nova-compute[72178]:   <features>
Aug 01 12:07:58 user nova-compute[72178]:     <acpi/>
Aug 01 12:07:58 user nova-compute[72178]:     <apic/>
Aug 01 12:07:58 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:07:58 user nova-compute[72178]:   </features>
Aug 01 12:07:58 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:07:58 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:07:58 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:07:58 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:07:58 user nova-compute[72178]:   </clock>
Aug 01 12:07:58 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:07:58 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:07:58 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:07:58 user nova-compute[72178]:   </cpu>
Aug 01 12:07:58 user nova-compute[72178]:   <devices>
Aug 01 12:07:58 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:07:58 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:07:58 user nova-compute[72178]:       <source dev="/dev/sdg"/>
Aug 01 12:07:58 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:07:58 user nova-compute[72178]:       <serial>1aaa80a6-89bc-4172-bdd7-6f6ab3e17987</serial>
Aug 01 12:07:58 user nova-compute[72178]:     </disk>
Aug 01 12:07:58 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:07:58 user nova-compute[72178]:       <mac address="fa:16:3e:be:52:74"/>
Aug 01 12:07:58 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:58 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:07:58 user nova-compute[72178]:       <target dev="tap29efbfad-3a"/>
Aug 01 12:07:58 user nova-compute[72178]:     </interface>
Aug 01 12:07:58 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:07:58 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/e7e1d3fe-99fe-41fe-bff7-5ea191c529de/console.log" append="off"/>
Aug 01 12:07:58 user nova-compute[72178]:     </serial>
Aug 01 12:07:58 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:07:58 user nova-compute[72178]:     <video>
Aug 01 12:07:58 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:07:58 user nova-compute[72178]:     </video>
Aug 01 12:07:58 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:07:58 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:07:58 user nova-compute[72178]:     </rng>
Aug 01 12:07:58 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:07:58 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:07:58 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:07:58 user nova-compute[72178]:     </memballoon>
Aug 01 12:07:58 user nova-compute[72178]:   </devices>
Aug 01 12:07:58 user nova-compute[72178]: </domain>
Aug 01 12:07:58 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83603559',display_name='tempest-ServerActionsTestOtherA-server-83603559',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83603559',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-4nops17y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=e7e1d3fe-99fe-41fe-bff7-5ea191c529de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG os_vif [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.network.neutron [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29efbfad-3a, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29efbfad-3a, col_values=(('external_ids', {'iface-id': '29efbfad-3acd-4d72-977a-776ed80c3b47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:52:74', 'vm-uuid': 'e7e1d3fe-99fe-41fe-bff7-5ea191c529de'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:07:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:07:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:58 user nova-compute[72178]: INFO os_vif [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a')
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No VIF found with MAC fa:16:3e:be:52:74, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:07:58 user nova-compute[72178]: INFO nova.virt.block_device [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Booting with volume snapshot 99bd71e4-c477-471b-aebb-cfe2685a7cc4 at /dev/vda
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.policy [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef22394fbdfd4aad8c301596a2ee7b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0eb9e0006c46dabba55cc95cca217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891678.8736541, 65e21777-de00-4f0a-9774-c1305ac68a43 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:07:58 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] VM Resumed (Lifecycle Event)
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:07:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance spawned successfully.
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:07:58 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891678.877714, 65e21777-de00-4f0a-9774-c1305ac68a43 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:07:58 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] VM Started (Lifecycle Event)
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:07:58 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:07:59 user nova-compute[72178]: INFO nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Took 12.77 seconds to spawn the instance on the hypervisor.
Aug 01 12:07:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:59 user nova-compute[72178]: DEBUG nova.network.neutron [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Successfully created port: 8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:07:59 user nova-compute[72178]: INFO nova.compute.manager [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Took 43.37 seconds to build instance.
Aug 01 12:07:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e69afa1e-a75f-4685-ad24-cab070ab69b5 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "65e21777-de00-4f0a-9774-c1305ac68a43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.534s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:07:59 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891664.5822887, f75a07e7-7cd8-4a63-b03d-422e07da25f8 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:07:59 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] VM Stopped (Lifecycle Event)
Aug 01 12:07:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b97af8e7-43c8-45dc-901a-9a287bc5dba2 None None] [instance: f75a07e7-7cd8-4a63-b03d-422e07da25f8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:07:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:07:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-9795386d-ed8b-4d2c-a6c6-dd6e46d86422 req-77eb6e6d-3480-4b09-af9c-4b72281a1663 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9795386d-ed8b-4d2c-a6c6-dd6e46d86422 req-77eb6e6d-3480-4b09-af9c-4b72281a1663 service nova] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9795386d-ed8b-4d2c-a6c6-dd6e46d86422 req-77eb6e6d-3480-4b09-af9c-4b72281a1663 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9795386d-ed8b-4d2c-a6c6-dd6e46d86422 req-77eb6e6d-3480-4b09-af9c-4b72281a1663 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-9795386d-ed8b-4d2c-a6c6-dd6e46d86422 req-77eb6e6d-3480-4b09-af9c-4b72281a1663 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] No waiting events found dispatching network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:00 user nova-compute[72178]: WARNING nova.compute.manager [req-9795386d-ed8b-4d2c-a6c6-dd6e46d86422 req-77eb6e6d-3480-4b09-af9c-4b72281a1663 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received unexpected event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 for instance with vm_state building and task_state spawning.
Aug 01 12:08:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.network.neutron [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Successfully updated port: 8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "refresh_cache-0fcffdc5-2321-4287-a89e-d3b7675e19f3" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquired lock "refresh_cache-0fcffdc5-2321-4287-a89e-d3b7675e19f3" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.network.neutron [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-28ae5cc8-acf9-48b5-b7ae-0321261c2bcf req-f586506c-f580-4a71-a5f0-8809fb58ef1f service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received event network-changed-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-28ae5cc8-acf9-48b5-b7ae-0321261c2bcf req-f586506c-f580-4a71-a5f0-8809fb58ef1f service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Refreshing instance network info cache due to event network-changed-8d50a070-54b3-443d-b54c-43c4a7f3dbcf. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-28ae5cc8-acf9-48b5-b7ae-0321261c2bcf req-f586506c-f580-4a71-a5f0-8809fb58ef1f service nova] Acquiring lock "refresh_cache-0fcffdc5-2321-4287-a89e-d3b7675e19f3" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.network.neutron [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.network.neutron [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Updating instance_info_cache with network_info: [{"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Releasing lock "refresh_cache-0fcffdc5-2321-4287-a89e-d3b7675e19f3" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Instance network_info: |[{"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-28ae5cc8-acf9-48b5-b7ae-0321261c2bcf req-f586506c-f580-4a71-a5f0-8809fb58ef1f service nova] Acquired lock "refresh_cache-0fcffdc5-2321-4287-a89e-d3b7675e19f3" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:00 user nova-compute[72178]: DEBUG nova.network.neutron [req-28ae5cc8-acf9-48b5-b7ae-0321261c2bcf req-f586506c-f580-4a71-a5f0-8809fb58ef1f service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Refreshing network info cache for port 8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:08:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-28ae5cc8-acf9-48b5-b7ae-0321261c2bcf req-f586506c-f580-4a71-a5f0-8809fb58ef1f service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Updated VIF entry in instance network info cache for port 8d50a070-54b3-443d-b54c-43c4a7f3dbcf. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:08:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-28ae5cc8-acf9-48b5-b7ae-0321261c2bcf req-f586506c-f580-4a71-a5f0-8809fb58ef1f service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Updating instance_info_cache with network_info: [{"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-28ae5cc8-acf9-48b5-b7ae-0321261c2bcf req-f586506c-f580-4a71-a5f0-8809fb58ef1f service nova] Releasing lock "refresh_cache-0fcffdc5-2321-4287-a89e-d3b7675e19f3" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-09a055ff-a58f-482d-9460-682236aa50eb req-80e3679c-21e5-43dc-9fba-ce81127b545d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-09a055ff-a58f-482d-9460-682236aa50eb req-80e3679c-21e5-43dc-9fba-ce81127b545d service nova] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-09a055ff-a58f-482d-9460-682236aa50eb req-80e3679c-21e5-43dc-9fba-ce81127b545d service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-09a055ff-a58f-482d-9460-682236aa50eb req-80e3679c-21e5-43dc-9fba-ce81127b545d service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-09a055ff-a58f-482d-9460-682236aa50eb req-80e3679c-21e5-43dc-9fba-ce81127b545d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] No waiting events found dispatching network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:02 user nova-compute[72178]: WARNING nova.compute.manager [req-09a055ff-a58f-482d-9460-682236aa50eb req-80e3679c-21e5-43dc-9fba-ce81127b545d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received unexpected event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 for instance with vm_state building and task_state spawning.
Aug 01 12:08:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891682.7443616, e7e1d3fe-99fe-41fe-bff7-5ea191c529de => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:08:02 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] VM Resumed (Lifecycle Event)
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:08:02 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance spawned successfully.
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:02 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891682.7454615, e7e1d3fe-99fe-41fe-bff7-5ea191c529de => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:08:02 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] VM Started (Lifecycle Event)
Aug 01 12:08:02 user nova-compute[72178]: INFO nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:08:02 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:08:03 user nova-compute[72178]: INFO nova.compute.manager [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Took 17.78 seconds to build instance.
Aug 01 12:08:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3bf071bb-ae24-473b-ba65-5b0a2e4f33a3 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.914s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG os_brick.utils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[be543e95-9332-491c-8b4c-daf0654e111e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a5da34-20ec-4a95-ac3b-cef20473361f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac24b577-0c5d-48b5-bbb0-5eb5a3ecaa88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adbd29a-6604-48dc-a270-0d6922027538]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:08:04 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:08:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[916849df-9049-4f02-93a1-bab3478e832e]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG os_brick.utils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:04 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Updating existing volume attachment record: e1b9836c-3e60-4ce1-943c-91fc3ac958ee {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:08:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-e42a62a3-9867-4dd8-a1b6-5fa48bf6d747 req-e6e518e5-85db-4945-b630-e1f2dc5c9a4a service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-changed-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-e42a62a3-9867-4dd8-a1b6-5fa48bf6d747 req-e6e518e5-85db-4945-b630-e1f2dc5c9a4a service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Refreshing instance network info cache due to event network-changed-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:08:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e42a62a3-9867-4dd8-a1b6-5fa48bf6d747 req-e6e518e5-85db-4945-b630-e1f2dc5c9a4a service nova] Acquiring lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e42a62a3-9867-4dd8-a1b6-5fa48bf6d747 req-e6e518e5-85db-4945-b630-e1f2dc5c9a4a service nova] Acquired lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:05 user nova-compute[72178]: DEBUG nova.network.neutron [req-e42a62a3-9867-4dd8-a1b6-5fa48bf6d747 req-e6e518e5-85db-4945-b630-e1f2dc5c9a4a service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Refreshing network info cache for port e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:08:06 user nova-compute[72178]: DEBUG nova.network.neutron [req-e42a62a3-9867-4dd8-a1b6-5fa48bf6d747 req-e6e518e5-85db-4945-b630-e1f2dc5c9a4a service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updated VIF entry in instance network info cache for port e47ac7c6-ea8c-4491-9e2a-2e227b2a305a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:08:06 user nova-compute[72178]: DEBUG nova.network.neutron [req-e42a62a3-9867-4dd8-a1b6-5fa48bf6d747 req-e6e518e5-85db-4945-b630-e1f2dc5c9a4a service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updating instance_info_cache with network_info: [{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e42a62a3-9867-4dd8-a1b6-5fa48bf6d747 req-e6e518e5-85db-4945-b630-e1f2dc5c9a4a service nova] Releasing lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-9c25062b-a4da-45cc-9926-70741fab104f req-29240536-c6cb-439b-afe8-ebb920d7f447 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-changed-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-9c25062b-a4da-45cc-9926-70741fab104f req-29240536-c6cb-439b-afe8-ebb920d7f447 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Refreshing instance network info cache due to event network-changed-daf90b1b-c7ac-491e-abf6-4f082775e49e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:08:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9c25062b-a4da-45cc-9926-70741fab104f req-29240536-c6cb-439b-afe8-ebb920d7f447 service nova] Acquiring lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9c25062b-a4da-45cc-9926-70741fab104f req-29240536-c6cb-439b-afe8-ebb920d7f447 service nova] Acquired lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:07 user nova-compute[72178]: DEBUG nova.network.neutron [req-9c25062b-a4da-45cc-9926-70741fab104f req-29240536-c6cb-439b-afe8-ebb920d7f447 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Refreshing network info cache for port daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:08:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-9c25062b-a4da-45cc-9926-70741fab104f req-29240536-c6cb-439b-afe8-ebb920d7f447 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Updated VIF entry in instance network info cache for port daf90b1b-c7ac-491e-abf6-4f082775e49e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:08:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-9c25062b-a4da-45cc-9926-70741fab104f req-29240536-c6cb-439b-afe8-ebb920d7f447 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Updating instance_info_cache with network_info: [{"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9c25062b-a4da-45cc-9926-70741fab104f req-29240536-c6cb-439b-afe8-ebb920d7f447 service nova] Releasing lock "refresh_cache-69cbbc9f-ec82-4a40-9f91-3941db5088e4" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:08 user nova-compute[72178]: INFO nova.compute.manager [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Rebuilding instance
Aug 01 12:08:08 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'trusted_certs' on Instance uuid 69cbbc9f-ec82-4a40-9f91-3941db5088e4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'pci_requests' on Instance uuid 69cbbc9f-ec82-4a40-9f91-3941db5088e4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'pci_devices' on Instance uuid 69cbbc9f-ec82-4a40-9f91-3941db5088e4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'resources' on Instance uuid 69cbbc9f-ec82-4a40-9f91-3941db5088e4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'migration_context' on Instance uuid 69cbbc9f-ec82-4a40-9f91-3941db5088e4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72178) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG nova.compute.manager [req-2a9172f7-de99-4e92-86ce-b539753f9598 req-a2902ea8-2e7e-42a7-98bd-6a6f6494134b service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-unplugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a9172f7-de99-4e92-86ce-b539753f9598 req-a2902ea8-2e7e-42a7-98bd-6a6f6494134b service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a9172f7-de99-4e92-86ce-b539753f9598 req-a2902ea8-2e7e-42a7-98bd-6a6f6494134b service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a9172f7-de99-4e92-86ce-b539753f9598 req-a2902ea8-2e7e-42a7-98bd-6a6f6494134b service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG nova.compute.manager [req-2a9172f7-de99-4e92-86ce-b539753f9598 req-a2902ea8-2e7e-42a7-98bd-6a6f6494134b service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] No waiting events found dispatching network-vif-unplugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:09 user nova-compute[72178]: WARNING nova.compute.manager [req-2a9172f7-de99-4e92-86ce-b539753f9598 req-a2902ea8-2e7e-42a7-98bd-6a6f6494134b service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received unexpected event network-vif-unplugged-daf90b1b-c7ac-491e-abf6-4f082775e49e for instance with vm_state active and task_state rebuilding.
Aug 01 12:08:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:10 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance destroyed successfully.
Aug 01 12:08:10 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance destroyed successfully.
Aug 01 12:08:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-835329579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-828231296',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxxZT+XJvl6cXt0RP6eIuO95cu9KfqyvLULPpXEBfcyImvOkOEINjqwZfkv7YYlz1KwfEdDpst8gzxwxzFCtDGY4W8U9WeIv8je0DaEQeVfjpEdkdvkrPrRgDiBrVWtgg==',key_name='tempest-keypair-1393248900',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-68hqtqu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=69cbbc9f-ec82-4a40-9f91-3941db5088e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_vif [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaf90b1b-c7, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:10 user nova-compute[72178]: INFO os_vif [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7')
Aug 01 12:08:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:10 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fd959d-b863-4d7a-a12c-e847602c7e26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02fc4f7-b330-4904-942d-4f8b9d131a7d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f44b6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4364991f-e6ee-4c71-a875-e2c409d1aef9]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a26609-7584-4394-b011-c55f77c07b4e]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a235a399-58a5-4559-a176-b6f55653d9b9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c527b2e0-ba36-47a1-aa88-9949ff2ccaa4]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe6b011d2-c6d884166cc97ee3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e6b011d2', '/dev/disk/by-id/scsi-26336643838343136') {{(pid=83857) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffe7ca3-4fd1-42ba-b4d9-3ff5e957d6b6]: (4, None) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f046ab2f-0415-44e9-83f9-8493f10c8743]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd3eed4-8ed8-4c45-ab6b-edfb6f59039e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260]
Aug 01 12:08:10 user nova-compute[72178]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260] successful.
Aug 01 12:08:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[18077467-328d-47b7-8d74-2defedfba963]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] <== disconnect_volume: return (401ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:08:10 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Deleting instance files /opt/stack/data/nova/instances/69cbbc9f-ec82-4a40-9f91-3941db5088e4_del
Aug 01 12:08:10 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Deletion of /opt/stack/data/nova/instances/69cbbc9f-ec82-4a40-9f91-3941db5088e4_del complete
Aug 01 12:08:10 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 69cbbc9f-ec82-4a40-9f91-3941db5088e4 could not be found.
Aug 01 12:08:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:10 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a34090-33f9-446c-8248-02d702e4c7a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f88d79-2d24-43d9-803a-96adac042e7a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:10 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f453e320>, {}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Disconnecting from: [] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] <== disconnect_volume: return (64ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:11 user nova-compute[72178]: INFO nova.compute.manager [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Shelving
Aug 01 12:08:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-1434d27f-a12f-4783-a3c7-35de4306ac78 req-88c3687c-d736-4c68-b3de-73a907a269e8 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1434d27f-a12f-4783-a3c7-35de4306ac78 req-88c3687c-d736-4c68-b3de-73a907a269e8 service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1434d27f-a12f-4783-a3c7-35de4306ac78 req-88c3687c-d736-4c68-b3de-73a907a269e8 service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1434d27f-a12f-4783-a3c7-35de4306ac78 req-88c3687c-d736-4c68-b3de-73a907a269e8 service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-1434d27f-a12f-4783-a3c7-35de4306ac78 req-88c3687c-d736-4c68-b3de-73a907a269e8 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] No waiting events found dispatching network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:11 user nova-compute[72178]: WARNING nova.compute.manager [req-1434d27f-a12f-4783-a3c7-35de4306ac78 req-88c3687c-d736-4c68-b3de-73a907a269e8 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received unexpected event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e for instance with vm_state active and task_state rebuilding.
Aug 01 12:08:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Preparing to wait for external event volume-reimaged-e6622ae6-bbb1-420e-a2f7-89085dfb1a6f {{(pid=72178) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-ca233c17-c9e6-4acf-a217-798f9467dd23 req-5e10a86c-a129-400f-a1ea-6a5a34adc387 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-unplugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ca233c17-c9e6-4acf-a217-798f9467dd23 req-5e10a86c-a129-400f-a1ea-6a5a34adc387 service nova] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ca233c17-c9e6-4acf-a217-798f9467dd23 req-5e10a86c-a129-400f-a1ea-6a5a34adc387 service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ca233c17-c9e6-4acf-a217-798f9467dd23 req-5e10a86c-a129-400f-a1ea-6a5a34adc387 service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-ca233c17-c9e6-4acf-a217-798f9467dd23 req-5e10a86c-a129-400f-a1ea-6a5a34adc387 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] No waiting events found dispatching network-vif-unplugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:12 user nova-compute[72178]: WARNING nova.compute.manager [req-ca233c17-c9e6-4acf-a217-798f9467dd23 req-5e10a86c-a129-400f-a1ea-6a5a34adc387 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received unexpected event network-vif-unplugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a for instance with vm_state active and task_state shelving.
Aug 01 12:08:12 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance destroyed successfully.
Aug 01 12:08:12 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Beginning cold snapshot process
Aug 01 12:08:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:08:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk /opt/stack/data/nova/instances/snapshots/tmpa0slfkii/66b1b1f7e1204e66b842650081850713 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk /opt/stack/data/nova/instances/snapshots/tmpa0slfkii/66b1b1f7e1204e66b842650081850713" returned: 0 in 1.101s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:13 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Snapshot extracted, beginning image upload
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-63bd143b-4fb2-4133-8aff-2311b4666b2e req-60bf2495-8cd6-467c-b005-51aea6c927b7 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-63bd143b-4fb2-4133-8aff-2311b4666b2e req-60bf2495-8cd6-467c-b005-51aea6c927b7 service nova] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-63bd143b-4fb2-4133-8aff-2311b4666b2e req-60bf2495-8cd6-467c-b005-51aea6c927b7 service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-63bd143b-4fb2-4133-8aff-2311b4666b2e req-60bf2495-8cd6-467c-b005-51aea6c927b7 service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-63bd143b-4fb2-4133-8aff-2311b4666b2e req-60bf2495-8cd6-467c-b005-51aea6c927b7 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] No waiting events found dispatching network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:14 user nova-compute[72178]: WARNING nova.compute.manager [req-63bd143b-4fb2-4133-8aff-2311b4666b2e req-60bf2495-8cd6-467c-b005-51aea6c927b7 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received unexpected event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a for instance with vm_state active and task_state shelving_image_uploading.
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:08:14 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Creating image(s)
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Ensure instance console log exists: /opt/stack/data/nova/instances/0fcffdc5-2321-4287-a89e-d3b7675e19f3/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.010s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Start _get_guest_xml network_info=[{"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbWdmiyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0fcffdc5-2321-4287-a89e-d3b7675e19f3', 'attached_at': '', 'detached_at': '', 'volume_id': '54f0b62b-b837-4a52-bcb2-cb41901b0840', 'serial': '54f0b62b-b837-4a52-bcb2-cb41901b0840'}, 'boot_index': 0, 'attachment_id': 'e1b9836c-3e60-4ce1-943c-91fc3ac958ee', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:08:14 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:08:14 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbWdmiyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:14 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:14 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:14 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5800727d-7218-4ef2-8b33-e7f12dcf5552]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:08:14 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d34b5a-bb0d-466c-ba28-0a0ef27d2e12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840] added
Aug 01 12:08:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[924b897c-1fac-46cc-965f-657e03f74fe5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b37516-eb26-4537-9230-92866b69c49e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbWdmiyS {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbWdmiyS" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f35783-64af-4eda-a92c-05da54f09785]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nbWdmiyS'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b625b6-d618-46fd-8592-4d99a20d10db]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a99e85-c2bf-41d5-9aac-f8ff1f507d59]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec873be8-c4c6-4f92-bd19-79ea2ac031c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840, portal: 172.16.0.220,3260]
Aug 01 12:08:14 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840, portal: 172.16.0.220,3260] successful.
Aug 01 12:08:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4746975a-3cc7-436d-88bd-11c709a48781]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5544339-2f0d-4db8-b3d4-520352d3e610]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[712bd228-3ac8-4213-a736-691fde778ee3]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: None {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbWdmiyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26661363239323365', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661363239323365', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1089155580',display_name='tempest-TestVolumeBootPattern-server-1089155580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1089155580',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-fewdfe57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:58Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=0fcffdc5-2321-4287-a89e-d3b7675e19f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b8:f0,bridge_name='br-int',has_traffic_filtering=True,id=8d50a070-54b3-443d-b54c-43c4a7f3dbcf,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d50a070-54') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.objects.instance [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fcffdc5-2321-4287-a89e-d3b7675e19f3 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:08:15 user nova-compute[72178]:   <uuid>0fcffdc5-2321-4287-a89e-d3b7675e19f3</uuid>
Aug 01 12:08:15 user nova-compute[72178]:   <name>instance-0000001a</name>
Aug 01 12:08:15 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:08:15 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:08:15 user nova-compute[72178]:   <metadata>
Aug 01 12:08:15 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:08:15 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:08:15 user nova-compute[72178]:       <nova:name>tempest-TestVolumeBootPattern-server-1089155580</nova:name>
Aug 01 12:08:15 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:08:14</nova:creationTime>
Aug 01 12:08:15 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:08:15 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:08:15 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:08:15 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:08:15 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:08:15 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:08:15 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:08:15 user nova-compute[72178]:       <nova:owner>
Aug 01 12:08:15 user nova-compute[72178]:         <nova:user uuid="ef22394fbdfd4aad8c301596a2ee7b61">tempest-TestVolumeBootPattern-1003407750-project-member</nova:user>
Aug 01 12:08:15 user nova-compute[72178]:         <nova:project uuid="1e0eb9e0006c46dabba55cc95cca217f">tempest-TestVolumeBootPattern-1003407750</nova:project>
Aug 01 12:08:15 user nova-compute[72178]:       </nova:owner>
Aug 01 12:08:15 user nova-compute[72178]:       <nova:ports>
Aug 01 12:08:15 user nova-compute[72178]:         <nova:port uuid="8d50a070-54b3-443d-b54c-43c4a7f3dbcf">
Aug 01 12:08:15 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 12:08:15 user nova-compute[72178]:         </nova:port>
Aug 01 12:08:15 user nova-compute[72178]:       </nova:ports>
Aug 01 12:08:15 user nova-compute[72178]:     </nova:instance>
Aug 01 12:08:15 user nova-compute[72178]:   </metadata>
Aug 01 12:08:15 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:08:15 user nova-compute[72178]:     <system>
Aug 01 12:08:15 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:08:15 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:08:15 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:08:15 user nova-compute[72178]:       <entry name="serial">0fcffdc5-2321-4287-a89e-d3b7675e19f3</entry>
Aug 01 12:08:15 user nova-compute[72178]:       <entry name="uuid">0fcffdc5-2321-4287-a89e-d3b7675e19f3</entry>
Aug 01 12:08:15 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:08:15 user nova-compute[72178]:     </system>
Aug 01 12:08:15 user nova-compute[72178]:   </sysinfo>
Aug 01 12:08:15 user nova-compute[72178]:   <os>
Aug 01 12:08:15 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:08:15 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:08:15 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:08:15 user nova-compute[72178]:   </os>
Aug 01 12:08:15 user nova-compute[72178]:   <features>
Aug 01 12:08:15 user nova-compute[72178]:     <acpi/>
Aug 01 12:08:15 user nova-compute[72178]:     <apic/>
Aug 01 12:08:15 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:08:15 user nova-compute[72178]:   </features>
Aug 01 12:08:15 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:08:15 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:08:15 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:08:15 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:08:15 user nova-compute[72178]:   </clock>
Aug 01 12:08:15 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:08:15 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:08:15 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:08:15 user nova-compute[72178]:   </cpu>
Aug 01 12:08:15 user nova-compute[72178]:   <devices>
Aug 01 12:08:15 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:08:15 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:08:15 user nova-compute[72178]:       <source dev="/dev/sdc"/>
Aug 01 12:08:15 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:08:15 user nova-compute[72178]:       <serial>54f0b62b-b837-4a52-bcb2-cb41901b0840</serial>
Aug 01 12:08:15 user nova-compute[72178]:     </disk>
Aug 01 12:08:15 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:08:15 user nova-compute[72178]:       <mac address="fa:16:3e:53:b8:f0"/>
Aug 01 12:08:15 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:08:15 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:08:15 user nova-compute[72178]:       <target dev="tap8d50a070-54"/>
Aug 01 12:08:15 user nova-compute[72178]:     </interface>
Aug 01 12:08:15 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:08:15 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/0fcffdc5-2321-4287-a89e-d3b7675e19f3/console.log" append="off"/>
Aug 01 12:08:15 user nova-compute[72178]:     </serial>
Aug 01 12:08:15 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:08:15 user nova-compute[72178]:     <video>
Aug 01 12:08:15 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:08:15 user nova-compute[72178]:     </video>
Aug 01 12:08:15 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:08:15 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:08:15 user nova-compute[72178]:     </rng>
Aug 01 12:08:15 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:08:15 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:08:15 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:08:15 user nova-compute[72178]:     </memballoon>
Aug 01 12:08:15 user nova-compute[72178]:   </devices>
Aug 01 12:08:15 user nova-compute[72178]: </domain>
Aug 01 12:08:15 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1089155580',display_name='tempest-TestVolumeBootPattern-server-1089155580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1089155580',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-fewdfe57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:07:58Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=0fcffdc5-2321-4287-a89e-d3b7675e19f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b8:f0,bridge_name='br-int',has_traffic_filtering=True,id=8d50a070-54b3-443d-b54c-43c4a7f3dbcf,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d50a070-54') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG os_vif [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b8:f0,bridge_name='br-int',has_traffic_filtering=True,id=8d50a070-54b3-443d-b54c-43c4a7f3dbcf,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d50a070-54') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d50a070-54, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d50a070-54, col_values=(('external_ids', {'iface-id': '8d50a070-54b3-443d-b54c-43c4a7f3dbcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:b8:f0', 'vm-uuid': '0fcffdc5-2321-4287-a89e-d3b7675e19f3'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:08:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:16 user nova-compute[72178]: INFO os_vif [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b8:f0,bridge_name='br-int',has_traffic_filtering=True,id=8d50a070-54b3-443d-b54c-43c4a7f3dbcf,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d50a070-54')
Aug 01 12:08:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:08:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No VIF found with MAC fa:16:3e:53:b8:f0, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:08:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Snapshot image upload complete
Aug 01 12:08:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:16 user nova-compute[72178]: INFO nova.compute.manager [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Shelve offloading
Aug 01 12:08:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance destroyed successfully.
Aug 01 12:08:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquired lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:08:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updating instance_info_cache with network_info: [{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Releasing lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-de629911-220d-43d6-aaef-ea4eae8fdd75 req-935d084b-b99e-45b4-97be-0bc59e1c8b49 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received event network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de629911-220d-43d6-aaef-ea4eae8fdd75 req-935d084b-b99e-45b4-97be-0bc59e1c8b49 service nova] Acquiring lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de629911-220d-43d6-aaef-ea4eae8fdd75 req-935d084b-b99e-45b4-97be-0bc59e1c8b49 service nova] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de629911-220d-43d6-aaef-ea4eae8fdd75 req-935d084b-b99e-45b4-97be-0bc59e1c8b49 service nova] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-de629911-220d-43d6-aaef-ea4eae8fdd75 req-935d084b-b99e-45b4-97be-0bc59e1c8b49 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] No waiting events found dispatching network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:18 user nova-compute[72178]: WARNING nova.compute.manager [req-de629911-220d-43d6-aaef-ea4eae8fdd75 req-935d084b-b99e-45b4-97be-0bc59e1c8b49 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received unexpected event network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf for instance with vm_state building and task_state spawning.
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance destroyed successfully.
Aug 01 12:08:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'resources' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1643210725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1643210725',id=19,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjAoXiXijaPgStwNb3E/WYuB63IX6EsfgH4MXYEG8WzG9jHBKzAWMRM5Ek/XHyV/s1ms9GKPP/t84r/7Q/M1HuC5cwkUk7L2lfwOVJUxSaSKKBbJtOUJjYdiD1PNY3xDQ==',key_name='tempest-keypair-1918189647',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-4l02fltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member',shelved_at='2023-08-01T12:08:16.752640',shelved_host='user',shelved_image_id='4dd1ca4d-1a00-4e3a-863a-db254fa79995'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:08:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=6341837b-67ea-42df-b3e9-c58e07857774,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG os_vif [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape47ac7c6-ea, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:08:18 user nova-compute[72178]: INFO os_vif [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea')
Aug 01 12:08:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Deleting instance files /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774_del
Aug 01 12:08:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Deletion of /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774_del complete
Aug 01 12:08:18 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Deleted allocations for instance 6341837b-67ea-42df-b3e9-c58e07857774
Aug 01 12:08:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:19 user nova-compute[72178]: DEBUG nova.objects.instance [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'numa_topology' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:19 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:08:19 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:08:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-314090a3-9371-4fa2-a2d4-afd2d4ec24f3 tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.134s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891700.2266726, 0fcffdc5-2321-4287-a89e-d3b7675e19f3 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:08:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] VM Resumed (Lifecycle Event)
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:08:20 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Instance spawned successfully.
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891700.2315178, 0fcffdc5-2321-4287-a89e-d3b7675e19f3 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:08:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] VM Started (Lifecycle Event)
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-c3a17b0f-4e96-4b12-a2e8-b03978700b59 req-47d50dd9-2b04-4b61-aac4-c9135f86f194 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received event network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c3a17b0f-4e96-4b12-a2e8-b03978700b59 req-47d50dd9-2b04-4b61-aac4-c9135f86f194 service nova] Acquiring lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c3a17b0f-4e96-4b12-a2e8-b03978700b59 req-47d50dd9-2b04-4b61-aac4-c9135f86f194 service nova] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c3a17b0f-4e96-4b12-a2e8-b03978700b59 req-47d50dd9-2b04-4b61-aac4-c9135f86f194 service nova] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-c3a17b0f-4e96-4b12-a2e8-b03978700b59 req-47d50dd9-2b04-4b61-aac4-c9135f86f194 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] No waiting events found dispatching network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:20 user nova-compute[72178]: WARNING nova.compute.manager [req-c3a17b0f-4e96-4b12-a2e8-b03978700b59 req-47d50dd9-2b04-4b61-aac4-c9135f86f194 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received unexpected event network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf for instance with vm_state building and task_state spawning.
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:08:20 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:08:20 user nova-compute[72178]: INFO nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 01 12:08:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:20 user nova-compute[72178]: INFO nova.compute.manager [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Took 22.80 seconds to build instance.
Aug 01 12:08:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22a7df2d-b0f2-4ab8-baa9-a0b9878b549d tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.921s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG nova.objects.instance [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'flavor' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Attaching volume 5367c6fe-b654-415f-ac02-36610a5ba891 to /dev/vdb
Aug 01 12:08:22 user nova-compute[72178]: DEBUG os_brick.utils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.063s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb7832-381a-4a7e-a3cb-07a900818e0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab26dd5-926a-4f16-b1ce-ef9fcc2617ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5527c7a6-4a4f-4dc7-9364-0319fab1aa50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d82f6e-9264-4eca-95f7-b139f0d67873]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:08:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:08:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:08:23 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:08:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec18bfdc-2699-4b51-94e9-8c733ac0fd7c]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:08:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:08:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:08:23 user nova-compute[72178]: DEBUG os_brick.utils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] <== get_connector_properties: return (214ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:23 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating existing volume attachment record: f2b80c8a-50c8-4b9a-bd8b-961fb2ebda6e {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:08:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:25 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891690.1645997, 69cbbc9f-ec82-4a40-9f91-3941db5088e4 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:08:25 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] VM Stopped (Lifecycle Event)
Aug 01 12:08:25 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aa219fac-854e-4b5f-8cd2-ed3bea2970ab None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:27 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891692.270116, 6341837b-67ea-42df-b3e9-c58e07857774 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:08:27 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] VM Stopped (Lifecycle Event)
Aug 01 12:08:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5b7a2e4-11cb-46bc-b244-44c439aa8f18 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:31 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:31 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drvNFkOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:32 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:32 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:32 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d0ffa4-2227-417c-af71-f42826896152]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:08:32 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28fbfad-770f-45de-8691-852524e49343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891] added
Aug 01 12:08:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8df106-4f58-4a37-bc62-8939f375a5f3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbf3ea8-e062-45c3-9872-068b9719b7df]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drvNFkOt {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drvNFkOt" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ed8b3f-d56c-4ea6-a4d4-31d7589ce8d5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'drvNFkOt'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c68ff2-5dc6-4402-96a1-eff8137c8787]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bda9bfb-8512-4a34-af7d-9aa6ab1720f3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf80545-98c1-43e0-b2ee-b8faa3c128e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260]
Aug 01 12:08:32 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260] successful.
Aug 01 12:08:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53e212e-0107-48f1-9169-9046d3eebd69]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad43f76a-2eb6-4a06-a74b-8a52cc162274]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:32 user nova-compute[72178]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] HCTL ('40', '-', '-', 0) found on session 28 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74971fd-02ff-4e2e-84b2-27727a19432c]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching for a device in session 28 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drvNFkOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:08:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '23461653536393961', 'path': '/dev/sdi'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461653536393961', 'path': '/dev/sdi'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG nova.objects.instance [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'flavor' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:08:33 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:08:33 user nova-compute[72178]:   <source dev="/dev/sdi"/>
Aug 01 12:08:33 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:08:33 user nova-compute[72178]:   <serial>5367c6fe-b654-415f-ac02-36610a5ba891</serial>
Aug 01 12:08:33 user nova-compute[72178]: </disk>
Aug 01 12:08:33 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:33 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No VIF found with MAC fa:16:3e:6f:fc:37, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-10a165d1-fdc4-430d-9aec-87c11ef487d2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.198s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-3b832db0-cad8-4857-b32f-fe39dc354ca1 req-e58ffcd5-0d32-4596-adad-5750c61a500c service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event volume-reimaged-e6622ae6-bbb1-420e-a2f7-89085dfb1a6f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3b832db0-cad8-4857-b32f-fe39dc354ca1 req-e58ffcd5-0d32-4596-adad-5750c61a500c service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3b832db0-cad8-4857-b32f-fe39dc354ca1 req-e58ffcd5-0d32-4596-adad-5750c61a500c service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3b832db0-cad8-4857-b32f-fe39dc354ca1 req-e58ffcd5-0d32-4596-adad-5750c61a500c service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-3b832db0-cad8-4857-b32f-fe39dc354ca1 req-e58ffcd5-0d32-4596-adad-5750c61a500c service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Processing event volume-reimaged-e6622ae6-bbb1-420e-a2f7-89085dfb1a6f {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance event wait completed in 23 seconds for volume-reimaged {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:08:35 user nova-compute[72178]: INFO nova.virt.block_device [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Booting with volume e6622ae6-bbb1-420e-a2f7-89085dfb1a6f at /dev/vda
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG os_brick.utils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11ddbd-4af7-447b-80af-3cf0b5170eca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b8bbd7-0c48-45e3-9da8-91b40e185c9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae994aa-fc4f-470e-8cad-473cb267f9cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d9558e-20f9-47c3-82c4-4fdd1579b402]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:08:36 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[659af4c1-7b20-4749-bde1-8146b4e5176d]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG os_brick.utils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Updating existing volume attachment record: d7122bf2-4f53-4fb3-9183-0bb1219fa380 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:38 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:08:38 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=6977MB free_disk=25.245220184326172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f4ae1965-8660-4deb-8427-cafa57f837c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 69cbbc9f-ec82-4a40-9f91-3941db5088e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 65e21777-de00-4f0a-9774-c1305ac68a43 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 45795fb0-12dd-4acc-990c-d1192e1ab54b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e7e1d3fe-99fe-41fe-bff7-5ea191c529de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 0fcffdc5-2321-4287-a89e-d3b7675e19f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:08:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:08:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Creating image(s)
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Ensure instance console log exists: /opt/stack/data/nova/instances/69cbbc9f-ec82-4a40-9f91-3941db5088e4/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Start _get_guest_xml network_info=[{"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '69cbbc9f-ec82-4a40-9f91-3941db5088e4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6622ae6-bbb1-420e-a2f7-89085dfb1a6f', 'serial': 'e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'}, 'boot_index': 0, 'attachment_id': 'd7122bf2-4f53-4fb3-9183-0bb1219fa380', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:08:45 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 12:08:45 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'vcpu_model' on Instance uuid 69cbbc9f-ec82-4a40-9f91-3941db5088e4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:45 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:45 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:45 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28719de-6309-4b3d-9247-072621ea4790]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:08:45 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5351cb1b-761c-47d7-b295-f41c76ec2414]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f] added
Aug 01 12:08:45 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[513af2f4-e3a4-490a-a134-35730489827c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.098s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b248b4b-354a-4b2f-9252-4af8dc78068a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQZDLiPh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQZDLiPh" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce0ce21-bb1f-412c-b06a-ab3dad67db57]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQZDLiPh'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[303bdcd0-8846-4b8e-8846-e933026dfb68]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c4b9a-7a79-456c-8e76-459a40baff82]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:45 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de590a6-38bb-480f-9c41-a18ab7d17d67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260]
Aug 01 12:08:46 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260] successful.
Aug 01 12:08:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0bc94e-1211-40e4-ba33-37d45a537d29]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e21a17-f9b9-4974-b7fa-37c8662317ae]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:46 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.471s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] HCTL ('39', '-', '-', 0) found on session 29 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.039s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bd196f-8124-40a2-8062-45e7951e1bf7]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Searching for a device in session 29 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-2a0d9d80-d27d-4ca0-a188-6bed23213303 req-08c508e7-89b7-4fb6-a105-ac9efc54be1b service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-2a0d9d80-d27d-4ca0-a188-6bed23213303 req-08c508e7-89b7-4fb6-a105-ac9efc54be1b service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing instance network info cache due to event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a0d9d80-d27d-4ca0-a188-6bed23213303 req-08c508e7-89b7-4fb6-a105-ac9efc54be1b service nova] Acquiring lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a0d9d80-d27d-4ca0-a188-6bed23213303 req-08c508e7-89b7-4fb6-a105-ac9efc54be1b service nova] Acquired lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:46 user nova-compute[72178]: DEBUG nova.network.neutron [req-2a0d9d80-d27d-4ca0-a188-6bed23213303 req-08c508e7-89b7-4fb6-a105-ac9efc54be1b service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.551s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] <== connect_volume: return (1552ms) {'type': 'block', 'scsi_wwn': '26336643838343136', 'path': '/dev/sdh'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336643838343136', 'path': '/dev/sdh'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-835329579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-828231296',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxxZT+XJvl6cXt0RP6eIuO95cu9KfqyvLULPpXEBfcyImvOkOEINjqwZfkv7YYlz1KwfEdDpst8gzxwxzFCtDGY4W8U9WeIv8je0DaEQeVfjpEdkdvkrPrRgDiBrVWtgg==',key_name='tempest-keypair-1393248900',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-68hqtqu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=69cbbc9f-ec82-4a40-9f91-3941db5088e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:08:47 user nova-compute[72178]:   <uuid>69cbbc9f-ec82-4a40-9f91-3941db5088e4</uuid>
Aug 01 12:08:47 user nova-compute[72178]:   <name>instance-00000014</name>
Aug 01 12:08:47 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:08:47 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:08:47 user nova-compute[72178]:   <metadata>
Aug 01 12:08:47 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:08:47 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:08:47 user nova-compute[72178]:       <nova:name>tempest-ServerActionsV293TestJSON-server-835329579</nova:name>
Aug 01 12:08:47 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:08:45</nova:creationTime>
Aug 01 12:08:47 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:08:47 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:08:47 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:08:47 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:08:47 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:08:47 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:08:47 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:08:47 user nova-compute[72178]:       <nova:owner>
Aug 01 12:08:47 user nova-compute[72178]:         <nova:user uuid="551db946d0e94b50af2c5c659f4c82ce">tempest-ServerActionsV293TestJSON-1322074-project-member</nova:user>
Aug 01 12:08:47 user nova-compute[72178]:         <nova:project uuid="7ee13aa6423e4d33bfe59e2a092a5578">tempest-ServerActionsV293TestJSON-1322074</nova:project>
Aug 01 12:08:47 user nova-compute[72178]:       </nova:owner>
Aug 01 12:08:47 user nova-compute[72178]:       <nova:ports>
Aug 01 12:08:47 user nova-compute[72178]:         <nova:port uuid="daf90b1b-c7ac-491e-abf6-4f082775e49e">
Aug 01 12:08:47 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 12:08:47 user nova-compute[72178]:         </nova:port>
Aug 01 12:08:47 user nova-compute[72178]:       </nova:ports>
Aug 01 12:08:47 user nova-compute[72178]:     </nova:instance>
Aug 01 12:08:47 user nova-compute[72178]:   </metadata>
Aug 01 12:08:47 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:08:47 user nova-compute[72178]:     <system>
Aug 01 12:08:47 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:08:47 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:08:47 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:08:47 user nova-compute[72178]:       <entry name="serial">69cbbc9f-ec82-4a40-9f91-3941db5088e4</entry>
Aug 01 12:08:47 user nova-compute[72178]:       <entry name="uuid">69cbbc9f-ec82-4a40-9f91-3941db5088e4</entry>
Aug 01 12:08:47 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:08:47 user nova-compute[72178]:     </system>
Aug 01 12:08:47 user nova-compute[72178]:   </sysinfo>
Aug 01 12:08:47 user nova-compute[72178]:   <os>
Aug 01 12:08:47 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:08:47 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:08:47 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:08:47 user nova-compute[72178]:   </os>
Aug 01 12:08:47 user nova-compute[72178]:   <features>
Aug 01 12:08:47 user nova-compute[72178]:     <acpi/>
Aug 01 12:08:47 user nova-compute[72178]:     <apic/>
Aug 01 12:08:47 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:08:47 user nova-compute[72178]:   </features>
Aug 01 12:08:47 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:08:47 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:08:47 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:08:47 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:08:47 user nova-compute[72178]:   </clock>
Aug 01 12:08:47 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:08:47 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:08:47 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:08:47 user nova-compute[72178]:   </cpu>
Aug 01 12:08:47 user nova-compute[72178]:   <devices>
Aug 01 12:08:47 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:08:47 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:08:47 user nova-compute[72178]:       <source dev="/dev/sdh"/>
Aug 01 12:08:47 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:08:47 user nova-compute[72178]:       <serial>e6622ae6-bbb1-420e-a2f7-89085dfb1a6f</serial>
Aug 01 12:08:47 user nova-compute[72178]:     </disk>
Aug 01 12:08:47 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:08:47 user nova-compute[72178]:       <mac address="fa:16:3e:3f:e1:31"/>
Aug 01 12:08:47 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:08:47 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:08:47 user nova-compute[72178]:       <target dev="tapdaf90b1b-c7"/>
Aug 01 12:08:47 user nova-compute[72178]:     </interface>
Aug 01 12:08:47 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:08:47 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/69cbbc9f-ec82-4a40-9f91-3941db5088e4/console.log" append="off"/>
Aug 01 12:08:47 user nova-compute[72178]:     </serial>
Aug 01 12:08:47 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:08:47 user nova-compute[72178]:     <video>
Aug 01 12:08:47 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:08:47 user nova-compute[72178]:     </video>
Aug 01 12:08:47 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:08:47 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:08:47 user nova-compute[72178]:     </rng>
Aug 01 12:08:47 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:08:47 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:08:47 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:08:47 user nova-compute[72178]:     </memballoon>
Aug 01 12:08:47 user nova-compute[72178]:   </devices>
Aug 01 12:08:47 user nova-compute[72178]: </domain>
Aug 01 12:08:47 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-835329579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-828231296',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxxZT+XJvl6cXt0RP6eIuO95cu9KfqyvLULPpXEBfcyImvOkOEINjqwZfkv7YYlz1KwfEdDpst8gzxwxzFCtDGY4W8U9WeIv8je0DaEQeVfjpEdkdvkrPrRgDiBrVWtgg==',key_name='tempest-keypair-1393248900',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-68hqtqu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=69cbbc9f-ec82-4a40-9f91-3941db5088e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG os_vif [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaf90b1b-c7, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdaf90b1b-c7, col_values=(('external_ids', {'iface-id': 'daf90b1b-c7ac-491e-abf6-4f082775e49e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:e1:31', 'vm-uuid': '69cbbc9f-ec82-4a40-9f91-3941db5088e4'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:47 user nova-compute[72178]: INFO os_vif [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7')
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] No VIF found with MAC fa:16:3e:3f:e1:31, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.network.neutron [req-2a0d9d80-d27d-4ca0-a188-6bed23213303 req-08c508e7-89b7-4fb6-a105-ac9efc54be1b service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updated VIF entry in instance network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG nova.network.neutron [req-2a0d9d80-d27d-4ca0-a188-6bed23213303 req-08c508e7-89b7-4fb6-a105-ac9efc54be1b service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating instance_info_cache with network_info: [{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a0d9d80-d27d-4ca0-a188-6bed23213303 req-08c508e7-89b7-4fb6-a105-ac9efc54be1b service nova] Releasing lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-3d0aa63e-21af-410e-bff1-ec494167304a req-563d3605-6f61-471b-9e68-32f160c744df service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-3d0aa63e-21af-410e-bff1-ec494167304a req-563d3605-6f61-471b-9e68-32f160c744df service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing instance network info cache due to event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d0aa63e-21af-410e-bff1-ec494167304a req-563d3605-6f61-471b-9e68-32f160c744df service nova] Acquiring lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d0aa63e-21af-410e-bff1-ec494167304a req-563d3605-6f61-471b-9e68-32f160c744df service nova] Acquired lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d0aa63e-21af-410e-bff1-ec494167304a req-563d3605-6f61-471b-9e68-32f160c744df service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-21c95fee-58bc-44ba-9f6c-8a60b504530a req-452cb54e-d9a5-44e7-850f-139dc4ff434c service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-21c95fee-58bc-44ba-9f6c-8a60b504530a req-452cb54e-d9a5-44e7-850f-139dc4ff434c service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-21c95fee-58bc-44ba-9f6c-8a60b504530a req-452cb54e-d9a5-44e7-850f-139dc4ff434c service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-21c95fee-58bc-44ba-9f6c-8a60b504530a req-452cb54e-d9a5-44e7-850f-139dc4ff434c service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-21c95fee-58bc-44ba-9f6c-8a60b504530a req-452cb54e-d9a5-44e7-850f-139dc4ff434c service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] No waiting events found dispatching network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:49 user nova-compute[72178]: WARNING nova.compute.manager [req-21c95fee-58bc-44ba-9f6c-8a60b504530a req-452cb54e-d9a5-44e7-850f-139dc4ff434c service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received unexpected event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e for instance with vm_state active and task_state rebuild_spawning.
Aug 01 12:08:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d0aa63e-21af-410e-bff1-ec494167304a req-563d3605-6f61-471b-9e68-32f160c744df service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updated VIF entry in instance network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:08:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d0aa63e-21af-410e-bff1-ec494167304a req-563d3605-6f61-471b-9e68-32f160c744df service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating instance_info_cache with network_info: [{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d0aa63e-21af-410e-bff1-ec494167304a req-563d3605-6f61-471b-9e68-32f160c744df service nova] Releasing lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891731.0257432, 69cbbc9f-ec82-4a40-9f91-3941db5088e4 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:08:51 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] VM Resumed (Lifecycle Event)
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:08:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance spawned successfully.
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:08:51 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891731.028456, 69cbbc9f-ec82-4a40-9f91-3941db5088e4 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:08:51 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] VM Started (Lifecycle Event)
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:51 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-4eee4784-c11e-4acb-b07e-e11e1eedba79 req-08296755-81c7-4b36-a561-8895c70e4bb4 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4eee4784-c11e-4acb-b07e-e11e1eedba79 req-08296755-81c7-4b36-a561-8895c70e4bb4 service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4eee4784-c11e-4acb-b07e-e11e1eedba79 req-08296755-81c7-4b36-a561-8895c70e4bb4 service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4eee4784-c11e-4acb-b07e-e11e1eedba79 req-08296755-81c7-4b36-a561-8895c70e4bb4 service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-4eee4784-c11e-4acb-b07e-e11e1eedba79 req-08296755-81c7-4b36-a561-8895c70e4bb4 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] No waiting events found dispatching network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:51 user nova-compute[72178]: WARNING nova.compute.manager [req-4eee4784-c11e-4acb-b07e-e11e1eedba79 req-08296755-81c7-4b36-a561-8895c70e4bb4 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received unexpected event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e for instance with vm_state active and task_state rebuild_spawning.
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72178) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3b832db0-cad8-4857-b32f-fe39dc354ca1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.136s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.097s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:08:51 user nova-compute[72178]: INFO nova.compute.claims [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Claim successful on node user
Aug 01 12:08:52 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.828s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:08:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:08:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:08:52 user nova-compute[72178]: INFO nova.virt.block_device [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Booting with volume fa4dbd87-fe59-416b-ac59-b2d3fc287be0 at /dev/vda
Aug 01 12:08:52 user nova-compute[72178]: DEBUG nova.policy [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '192962f272724516b92bb7c10add101b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '729b625630fd4a26ba76891d65a5f5bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG os_brick.utils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd876c8-a083-42bf-bc8b-bd6df1d5e477]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[476fc070-bb1d-4708-861f-cba146306597]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b0419b-79fe-400a-9eb8-0c36412b4b4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ecc817-74cb-475b-b8ed-84743edc6522]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:08:52 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:08:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c265011-0fd2-4e15-aadd-63e8e805862c]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG os_brick.utils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:52 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating existing volume attachment record: 9dc4afab-3b86-46d6-8fda-027b6dbaf504 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:08:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Successfully created port: ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Successfully updated port: ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquired lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-527feb80-1a23-483e-a327-5a5b030f9c1c req-b29f573d-da59-4a3d-9d5c-a0186114690f service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-527feb80-1a23-483e-a327-5a5b030f9c1c req-b29f573d-da59-4a3d-9d5c-a0186114690f service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing instance network info cache due to event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-527feb80-1a23-483e-a327-5a5b030f9c1c req-b29f573d-da59-4a3d-9d5c-a0186114690f service nova] Acquiring lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Releasing lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance network_info: |[{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-527feb80-1a23-483e-a327-5a5b030f9c1c req-b29f573d-da59-4a3d-9d5c-a0186114690f service nova] Acquired lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-527feb80-1a23-483e-a327-5a5b030f9c1c req-b29f573d-da59-4a3d-9d5c-a0186114690f service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:55 user nova-compute[72178]: INFO nova.compute.manager [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Rebooting instance
Aug 01 12:08:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquired lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG nova.network.neutron [req-527feb80-1a23-483e-a327-5a5b030f9c1c req-b29f573d-da59-4a3d-9d5c-a0186114690f service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updated VIF entry in instance network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG nova.network.neutron [req-527feb80-1a23-483e-a327-5a5b030f9c1c req-b29f573d-da59-4a3d-9d5c-a0186114690f service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-527feb80-1a23-483e-a327-5a5b030f9c1c req-b29f573d-da59-4a3d-9d5c-a0186114690f service nova] Releasing lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating instance_info_cache with network_info: [{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:08:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Releasing lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG nova.compute.manager [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-6ba7d34d-0671-48a9-9acc-62427d3976d8 req-77634d5b-0a5b-4224-99b4-cc6474e252b2 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-unplugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6ba7d34d-0671-48a9-9acc-62427d3976d8 req-77634d5b-0a5b-4224-99b4-cc6474e252b2 service nova] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6ba7d34d-0671-48a9-9acc-62427d3976d8 req-77634d5b-0a5b-4224-99b4-cc6474e252b2 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6ba7d34d-0671-48a9-9acc-62427d3976d8 req-77634d5b-0a5b-4224-99b4-cc6474e252b2 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-6ba7d34d-0671-48a9-9acc-62427d3976d8 req-77634d5b-0a5b-4224-99b4-cc6474e252b2 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] No waiting events found dispatching network-vif-unplugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:56 user nova-compute[72178]: WARNING nova.compute.manager [req-6ba7d34d-0671-48a9-9acc-62427d3976d8 req-77634d5b-0a5b-4224-99b4-cc6474e252b2 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received unexpected event network-vif-unplugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 12:08:56 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Instance destroyed successfully.
Aug 01 12:08:56 user nova-compute[72178]: DEBUG nova.objects.instance [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'resources' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-284171792',display_name='tempest-TestMinimumBasicScenario-server-284171792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-284171792',id=21,image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8KTalSFvFaNrS1jliZnVrtNwKK4AozywHPcPo+QrbagBuFCxc3RURQwYNZ3xrdIYaSKaentOzwbBBIX4WKQeABSNCDvrrp7zftymG+1qdx+PWxJe8paCRFlMslpcuOw==',key_name='tempest-TestMinimumBasicScenario-121859531',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-suzi3c00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:08:56Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG os_vif [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6e7f28c-7e, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:08:56 user nova-compute[72178]: INFO os_vif [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e')
Aug 01 12:08:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drvNFkOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:56 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:08:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:08:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9addd685-a179-4a30-8919-796a1e15526f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae04b12-8571-4918-8423-c16d50e041ee]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d45f1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891'): ({'sdi'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Removing single pathed devices sdi {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d98578e-e719-4fba-8055-b50f7ce5cf01]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f40e2b-cd77-451f-b54e-99568821baf7]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flushing IO for device /dev/sdi {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a9ab77-4d07-4216-8d5b-9d5cb179a705]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.061s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5520483-a7d2-44b0-8fb6-06e413233271]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] SCSI volumes sdi have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad4e933-e039-47d8-95c8-74d21ac2a385]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b4708e-e89b-4ad7-9315-def6681ec678]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260]
Aug 01 12:08:57 user nova-compute[72178]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260] successful.
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf954d5-7c02-4844-8350-55db0b444bfb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] <== disconnect_volume: return (361ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Start _get_guest_xml network_info=[{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7f47eb43-d82d-4d50-a76b-fe78e3c3a21b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '7f47eb43-d82d-4d50-a76b-fe78e3c3a21b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drvNFkOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'd24e0764-b1cf-4b56-bcfe-73e92ed7c7fb', 'attached_at': '', 'detached_at': '', 'volume_id': '5367c6fe-b654-415f-ac02-36610a5ba891', 'serial': '5367c6fe-b654-415f-ac02-36610a5ba891'}, 'boot_index': None, 'attachment_id': 'f2b80c8a-50c8-4b9a-bd8b-961fb2ebda6e', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:08:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:08:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7f47eb43-d82d-4d50-a76b-fe78e3c3a21b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.objects.instance [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'vcpu_model' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drvNFkOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:08:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:08:57 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[139641bc-4b77-46b0-a825-0a5c964dc956]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:08:57 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab4da8c-a434-42e0-9085-336bb60c3482]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891] added
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e620ba0-e8ba-4bcf-8594-7cd833ed59bf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e384395-a7d5-4dce-996d-ca934008ad25]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drvNFkOt {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drvNFkOt" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dab6f25-80d3-45d6-ac4b-d004a56460af]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'drvNFkOt'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.057s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e92566c-852b-4124-97b1-7e0c5adb8047]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee5453b-5a55-4e61-a2e6-55882dcc6441]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9bdb40-3f42-44ea-81ef-f48fff433e51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260]
Aug 01 12:08:57 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260] successful.
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[80080ac5-175d-4ba5-abfb-94648e275724]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddbf75f-2a2b-4d16-a037-9794a44922ea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:08:57 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:08:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] HCTL ('40', '-', '-', 0) found on session 30 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[994db733-3b24-4026-8c7e-140a7b5a7e1d]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching for a device in session 30 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:08:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drvNFkOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-0dceba7e-819f-4282-899c-fb136697e012 req-dc90fac1-4ae4-401e-a5f8-02247d49cc1e service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0dceba7e-819f-4282-899c-fb136697e012 req-dc90fac1-4ae4-401e-a5f8-02247d49cc1e service nova] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0dceba7e-819f-4282-899c-fb136697e012 req-dc90fac1-4ae4-401e-a5f8-02247d49cc1e service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0dceba7e-819f-4282-899c-fb136697e012 req-dc90fac1-4ae4-401e-a5f8-02247d49cc1e service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-0dceba7e-819f-4282-899c-fb136697e012 req-dc90fac1-4ae4-401e-a5f8-02247d49cc1e service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] No waiting events found dispatching network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:08:58 user nova-compute[72178]: WARNING nova.compute.manager [req-0dceba7e-819f-4282-899c-fb136697e012 req-dc90fac1-4ae4-401e-a5f8-02247d49cc1e service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received unexpected event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 12:08:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23461653536393961', 'path': '/dev/sdi'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461653536393961', 'path': '/dev/sdi'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-284171792',display_name='tempest-TestMinimumBasicScenario-server-284171792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-284171792',id=21,image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8KTalSFvFaNrS1jliZnVrtNwKK4AozywHPcPo+QrbagBuFCxc3RURQwYNZ3xrdIYaSKaentOzwbBBIX4WKQeABSNCDvrrp7zftymG+1qdx+PWxJe8paCRFlMslpcuOw==',key_name='tempest-TestMinimumBasicScenario-121859531',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-suzi3c00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:08:56Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG nova.objects.instance [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'pci_devices' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:08:58 user nova-compute[72178]:   <uuid>d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb</uuid>
Aug 01 12:08:58 user nova-compute[72178]:   <name>instance-00000015</name>
Aug 01 12:08:58 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:08:58 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:08:58 user nova-compute[72178]:   <metadata>
Aug 01 12:08:58 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:08:58 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:08:58 user nova-compute[72178]:       <nova:name>tempest-TestMinimumBasicScenario-server-284171792</nova:name>
Aug 01 12:08:58 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:08:57</nova:creationTime>
Aug 01 12:08:58 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:08:58 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:08:58 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:08:58 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:08:58 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:08:58 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:08:58 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:08:58 user nova-compute[72178]:       <nova:owner>
Aug 01 12:08:58 user nova-compute[72178]:         <nova:user uuid="a5decc5e0a6b442c8ae65673dc854985">tempest-TestMinimumBasicScenario-1575364257-project-member</nova:user>
Aug 01 12:08:58 user nova-compute[72178]:         <nova:project uuid="c9aad2b5a65c4d8b8cdacafe727db4e3">tempest-TestMinimumBasicScenario-1575364257</nova:project>
Aug 01 12:08:58 user nova-compute[72178]:       </nova:owner>
Aug 01 12:08:58 user nova-compute[72178]:       <nova:root type="image" uuid="7f47eb43-d82d-4d50-a76b-fe78e3c3a21b"/>
Aug 01 12:08:58 user nova-compute[72178]:       <nova:ports>
Aug 01 12:08:58 user nova-compute[72178]:         <nova:port uuid="b6e7f28c-7e67-4026-9f1b-ca5884180e74">
Aug 01 12:08:58 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 12:08:58 user nova-compute[72178]:         </nova:port>
Aug 01 12:08:58 user nova-compute[72178]:       </nova:ports>
Aug 01 12:08:58 user nova-compute[72178]:     </nova:instance>
Aug 01 12:08:58 user nova-compute[72178]:   </metadata>
Aug 01 12:08:58 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:08:58 user nova-compute[72178]:     <system>
Aug 01 12:08:58 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:08:58 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:08:58 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:08:58 user nova-compute[72178]:       <entry name="serial">d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb</entry>
Aug 01 12:08:58 user nova-compute[72178]:       <entry name="uuid">d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb</entry>
Aug 01 12:08:58 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:08:58 user nova-compute[72178]:     </system>
Aug 01 12:08:58 user nova-compute[72178]:   </sysinfo>
Aug 01 12:08:58 user nova-compute[72178]:   <os>
Aug 01 12:08:58 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:08:58 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:08:58 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:08:58 user nova-compute[72178]:   </os>
Aug 01 12:08:58 user nova-compute[72178]:   <features>
Aug 01 12:08:58 user nova-compute[72178]:     <acpi/>
Aug 01 12:08:58 user nova-compute[72178]:     <apic/>
Aug 01 12:08:58 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:08:58 user nova-compute[72178]:   </features>
Aug 01 12:08:58 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:08:58 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:08:58 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:08:58 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:08:58 user nova-compute[72178]:   </clock>
Aug 01 12:08:58 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:08:58 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:08:58 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:08:58 user nova-compute[72178]:   </cpu>
Aug 01 12:08:58 user nova-compute[72178]:   <devices>
Aug 01 12:08:58 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:08:58 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:08:58 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk"/>
Aug 01 12:08:58 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:08:58 user nova-compute[72178]:     </disk>
Aug 01 12:08:58 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:08:58 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:08:58 user nova-compute[72178]:       <source dev="/dev/sdi"/>
Aug 01 12:08:58 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:08:58 user nova-compute[72178]:       <serial>5367c6fe-b654-415f-ac02-36610a5ba891</serial>
Aug 01 12:08:58 user nova-compute[72178]:     </disk>
Aug 01 12:08:58 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:08:58 user nova-compute[72178]:       <mac address="fa:16:3e:6f:fc:37"/>
Aug 01 12:08:58 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:08:58 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:08:58 user nova-compute[72178]:       <target dev="tapb6e7f28c-7e"/>
Aug 01 12:08:58 user nova-compute[72178]:     </interface>
Aug 01 12:08:58 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:08:58 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/console.log" append="off"/>
Aug 01 12:08:58 user nova-compute[72178]:     </serial>
Aug 01 12:08:58 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:08:58 user nova-compute[72178]:     <video>
Aug 01 12:08:58 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:08:58 user nova-compute[72178]:     </video>
Aug 01 12:08:58 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:08:58 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:08:58 user nova-compute[72178]:     </rng>
Aug 01 12:08:58 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:08:58 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:08:58 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:08:58 user nova-compute[72178]:     </memballoon>
Aug 01 12:08:58 user nova-compute[72178]:   </devices>
Aug 01 12:08:58 user nova-compute[72178]: </domain>
Aug 01 12:08:58 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:08:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG nova.objects.instance [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'trusted_certs' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Cannot resize image /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG nova.objects.instance [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'migration_context' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-284171792',display_name='tempest-TestMinimumBasicScenario-server-284171792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-284171792',id=21,image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8KTalSFvFaNrS1jliZnVrtNwKK4AozywHPcPo+QrbagBuFCxc3RURQwYNZ3xrdIYaSKaentOzwbBBIX4WKQeABSNCDvrrp7zftymG+1qdx+PWxJe8paCRFlMslpcuOw==',key_name='tempest-TestMinimumBasicScenario-121859531',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-suzi3c00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:08:56Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG os_vif [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6e7f28c-7e, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6e7f28c-7e, col_values=(('external_ids', {'iface-id': 'b6e7f28c-7e67-4026-9f1b-ca5884180e74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:fc:37', 'vm-uuid': 'd24e0764-b1cf-4b56-bcfe-73e92ed7c7fb'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:08:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:08:59 user nova-compute[72178]: INFO os_vif [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e')
Aug 01 12:09:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-4108c6ce-be96-43dd-b957-dc466b1e5de6 req-3449fc8e-2aa6-4afe-83d8-a9c9ee234e10 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4108c6ce-be96-43dd-b957-dc466b1e5de6 req-3449fc8e-2aa6-4afe-83d8-a9c9ee234e10 service nova] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4108c6ce-be96-43dd-b957-dc466b1e5de6 req-3449fc8e-2aa6-4afe-83d8-a9c9ee234e10 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4108c6ce-be96-43dd-b957-dc466b1e5de6 req-3449fc8e-2aa6-4afe-83d8-a9c9ee234e10 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-4108c6ce-be96-43dd-b957-dc466b1e5de6 req-3449fc8e-2aa6-4afe-83d8-a9c9ee234e10 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] No waiting events found dispatching network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:01 user nova-compute[72178]: WARNING nova.compute.manager [req-4108c6ce-be96-43dd-b957-dc466b1e5de6 req-3449fc8e-2aa6-4afe-83d8-a9c9ee234e10 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received unexpected event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 12:09:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:09:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Creating image(s)
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Ensure instance console log exists: /opt/stack/data/nova/instances/c2b7b3b8-1ed3-4754-9699-16839c7394c7/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Start _get_guest_xml network_info=[{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUfTGMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2b7b3b8-1ed3-4754-9699-16839c7394c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa4dbd87-fe59-416b-ac59-b2d3fc287be0', 'serial': 'fa4dbd87-fe59-416b-ac59-b2d3fc287be0'}, 'boot_index': 0, 'attachment_id': '9dc4afab-3b86-46d6-8fda-027b6dbaf504', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:09:03 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:09:03 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUfTGMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:03 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:03 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:03 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1781df-b5bd-4bf0-9274-af9776b9e0d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:09:03 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[367ccd02-613c-4988-b5b4-46b3f1904688]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0] added
Aug 01 12:09:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e185ebe-76a9-4eec-b9cd-757b83245478]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a48883d-d736-4eeb-adc9-e302233e9653]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUfTGMXR {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUfTGMXR" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a934f04-13d6-41d0-98b4-dbf1f47f83c2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUfTGMXR'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8faf68-d8a3-4e02-9b60-bd4ef7f312ef]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[667122bc-4e23-413d-80c3-adde1ddb272a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[95217b41-4881-4b64-aace-b0fae82df2fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260]
Aug 01 12:09:03 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260] successful.
Aug 01 12:09:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[50129ed5-5619-4d5a-a1cf-6cd4b9b11f85]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b0a87b-d050-4e2a-af5d-1472f9879411]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] HCTL ('41', '-', '-', 0) found on session 31 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d80db8-6b32-43d0-89c8-41e11255e111]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Searching for a device in session 31 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUfTGMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [req-e845da61-41ec-4230-94c1-673f4f59efc8 req-a1894edf-a6dc-4a61-b7fa-5b412838c129 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e845da61-41ec-4230-94c1-673f4f59efc8 req-a1894edf-a6dc-4a61-b7fa-5b412838c129 service nova] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e845da61-41ec-4230-94c1-673f4f59efc8 req-a1894edf-a6dc-4a61-b7fa-5b412838c129 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e845da61-41ec-4230-94c1-673f4f59efc8 req-a1894edf-a6dc-4a61-b7fa-5b412838c129 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [req-e845da61-41ec-4230-94c1-673f4f59efc8 req-a1894edf-a6dc-4a61-b7fa-5b412838c129 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] No waiting events found dispatching network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:03 user nova-compute[72178]: WARNING nova.compute.manager [req-e845da61-41ec-4230-94c1-673f4f59efc8 req-a1894edf-a6dc-4a61-b7fa-5b412838c129 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received unexpected event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 for instance with vm_state active and task_state reboot_started_hard.
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891743.853054, d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:09:03 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] VM Resumed (Lifecycle Event)
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:09:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Instance rebooted successfully.
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:09:03 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891743.8553474, d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:09:03 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] VM Started (Lifecycle Event)
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dce7cb07-e396-4955-8c69-1792e0d1b317 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.962s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '23038653137393539', 'path': '/dev/sdj'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038653137393539', 'path': '/dev/sdj'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1328072652',display_name='tempest-TestShelveInstance-server-1328072652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1328072652',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwjwe2NdthKjiiiDi8LPsHxZ0tDKDs/9Uun1Ww17FDngKtnc7NvmGm3AznOcjSbg9LqkomceEK+3+pVvsZSqMdN7zaprPelRi8gxSWDIdFhuk2cLYa22E7aX89S4/oyPg==',key_name='tempest-TestShelveInstance-619818221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729b625630fd4a26ba76891d65a5f5bc',ramdisk_id='',reservation_id='r-2737bifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-297202234',owner_user_name='tempest-TestShelveInstance-297202234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:08:52Z,user_data=None,user_id='192962f272724516b92bb7c10add101b',uuid=c2b7b3b8-1ed3-4754-9699-16839c7394c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converting VIF {"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lazy-loading 'pci_devices' on Instance uuid c2b7b3b8-1ed3-4754-9699-16839c7394c7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:09:04 user nova-compute[72178]:   <uuid>c2b7b3b8-1ed3-4754-9699-16839c7394c7</uuid>
Aug 01 12:09:04 user nova-compute[72178]:   <name>instance-0000001b</name>
Aug 01 12:09:04 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:09:04 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:09:04 user nova-compute[72178]:   <metadata>
Aug 01 12:09:04 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:09:04 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:09:04 user nova-compute[72178]:       <nova:name>tempest-TestShelveInstance-server-1328072652</nova:name>
Aug 01 12:09:04 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:09:03</nova:creationTime>
Aug 01 12:09:04 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:09:04 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:09:04 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:09:04 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:09:04 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:09:04 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:09:04 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:09:04 user nova-compute[72178]:       <nova:owner>
Aug 01 12:09:04 user nova-compute[72178]:         <nova:user uuid="192962f272724516b92bb7c10add101b">tempest-TestShelveInstance-297202234-project-member</nova:user>
Aug 01 12:09:04 user nova-compute[72178]:         <nova:project uuid="729b625630fd4a26ba76891d65a5f5bc">tempest-TestShelveInstance-297202234</nova:project>
Aug 01 12:09:04 user nova-compute[72178]:       </nova:owner>
Aug 01 12:09:04 user nova-compute[72178]:       <nova:ports>
Aug 01 12:09:04 user nova-compute[72178]:         <nova:port uuid="ee85ca88-4f2e-40c5-aca3-d3114cd5c03a">
Aug 01 12:09:04 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 12:09:04 user nova-compute[72178]:         </nova:port>
Aug 01 12:09:04 user nova-compute[72178]:       </nova:ports>
Aug 01 12:09:04 user nova-compute[72178]:     </nova:instance>
Aug 01 12:09:04 user nova-compute[72178]:   </metadata>
Aug 01 12:09:04 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:09:04 user nova-compute[72178]:     <system>
Aug 01 12:09:04 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:09:04 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:09:04 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:09:04 user nova-compute[72178]:       <entry name="serial">c2b7b3b8-1ed3-4754-9699-16839c7394c7</entry>
Aug 01 12:09:04 user nova-compute[72178]:       <entry name="uuid">c2b7b3b8-1ed3-4754-9699-16839c7394c7</entry>
Aug 01 12:09:04 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:09:04 user nova-compute[72178]:     </system>
Aug 01 12:09:04 user nova-compute[72178]:   </sysinfo>
Aug 01 12:09:04 user nova-compute[72178]:   <os>
Aug 01 12:09:04 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:09:04 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:09:04 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:09:04 user nova-compute[72178]:   </os>
Aug 01 12:09:04 user nova-compute[72178]:   <features>
Aug 01 12:09:04 user nova-compute[72178]:     <acpi/>
Aug 01 12:09:04 user nova-compute[72178]:     <apic/>
Aug 01 12:09:04 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:09:04 user nova-compute[72178]:   </features>
Aug 01 12:09:04 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:09:04 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:09:04 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:09:04 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:09:04 user nova-compute[72178]:   </clock>
Aug 01 12:09:04 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:09:04 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:09:04 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:09:04 user nova-compute[72178]:   </cpu>
Aug 01 12:09:04 user nova-compute[72178]:   <devices>
Aug 01 12:09:04 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:09:04 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:09:04 user nova-compute[72178]:       <source dev="/dev/sdj"/>
Aug 01 12:09:04 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:09:04 user nova-compute[72178]:       <serial>fa4dbd87-fe59-416b-ac59-b2d3fc287be0</serial>
Aug 01 12:09:04 user nova-compute[72178]:     </disk>
Aug 01 12:09:04 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:09:04 user nova-compute[72178]:       <mac address="fa:16:3e:dc:63:db"/>
Aug 01 12:09:04 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:09:04 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:09:04 user nova-compute[72178]:       <target dev="tapee85ca88-4f"/>
Aug 01 12:09:04 user nova-compute[72178]:     </interface>
Aug 01 12:09:04 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:09:04 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/c2b7b3b8-1ed3-4754-9699-16839c7394c7/console.log" append="off"/>
Aug 01 12:09:04 user nova-compute[72178]:     </serial>
Aug 01 12:09:04 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:09:04 user nova-compute[72178]:     <video>
Aug 01 12:09:04 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:09:04 user nova-compute[72178]:     </video>
Aug 01 12:09:04 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:09:04 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:09:04 user nova-compute[72178]:     </rng>
Aug 01 12:09:04 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:09:04 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:09:04 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:09:04 user nova-compute[72178]:     </memballoon>
Aug 01 12:09:04 user nova-compute[72178]:   </devices>
Aug 01 12:09:04 user nova-compute[72178]: </domain>
Aug 01 12:09:04 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1328072652',display_name='tempest-TestShelveInstance-server-1328072652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1328072652',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwjwe2NdthKjiiiDi8LPsHxZ0tDKDs/9Uun1Ww17FDngKtnc7NvmGm3AznOcjSbg9LqkomceEK+3+pVvsZSqMdN7zaprPelRi8gxSWDIdFhuk2cLYa22E7aX89S4/oyPg==',key_name='tempest-TestShelveInstance-619818221',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='729b625630fd4a26ba76891d65a5f5bc',ramdisk_id='',reservation_id='r-2737bifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-297202234',owner_user_name='tempest-TestShelveInstance-297202234-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:08:52Z,user_data=None,user_id='192962f272724516b92bb7c10add101b',uuid=c2b7b3b8-1ed3-4754-9699-16839c7394c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converting VIF {"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG os_vif [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee85ca88-4f, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee85ca88-4f, col_values=(('external_ids', {'iface-id': 'ee85ca88-4f2e-40c5-aca3-d3114cd5c03a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:63:db', 'vm-uuid': 'c2b7b3b8-1ed3-4754-9699-16839c7394c7'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:04 user nova-compute[72178]: INFO os_vif [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f')
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:09:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] No VIF found with MAC fa:16:3e:dc:63:db, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-5446fa6d-3d1e-4d9c-95d1-12be2c116c74 req-f9dbcd37-db2a-4a52-9b16-f7ff688b0141 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5446fa6d-3d1e-4d9c-95d1-12be2c116c74 req-f9dbcd37-db2a-4a52-9b16-f7ff688b0141 service nova] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5446fa6d-3d1e-4d9c-95d1-12be2c116c74 req-f9dbcd37-db2a-4a52-9b16-f7ff688b0141 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5446fa6d-3d1e-4d9c-95d1-12be2c116c74 req-f9dbcd37-db2a-4a52-9b16-f7ff688b0141 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-5446fa6d-3d1e-4d9c-95d1-12be2c116c74 req-f9dbcd37-db2a-4a52-9b16-f7ff688b0141 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] No waiting events found dispatching network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:06 user nova-compute[72178]: WARNING nova.compute.manager [req-5446fa6d-3d1e-4d9c-95d1-12be2c116c74 req-f9dbcd37-db2a-4a52-9b16-f7ff688b0141 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received unexpected event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a for instance with vm_state building and task_state spawning.
Aug 01 12:09:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] No waiting events found dispatching network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:08 user nova-compute[72178]: WARNING nova.compute.manager [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received unexpected event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a for instance with vm_state building and task_state spawning.
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-changed-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing instance network info cache due to event network-changed-0222d3a2-c922-4175-b9d9-9962d26eeda7. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] Acquiring lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] Acquired lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Refreshing network info cache for port 0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891748.6726594, c2b7b3b8-1ed3-4754-9699-16839c7394c7 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:09:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] VM Resumed (Lifecycle Event)
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:09:08 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance spawned successfully.
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:09:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891748.6751573, c2b7b3b8-1ed3-4754-9699-16839c7394c7 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:09:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] VM Started (Lifecycle Event)
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:09:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:09:08 user nova-compute[72178]: INFO nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 01 12:09:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:09 user nova-compute[72178]: INFO nova.compute.manager [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Took 17.78 seconds to build instance.
Aug 01 12:09:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9387857b-62c7-4d95-897d-ebdd338a7773 tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.901s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updated VIF entry in instance network info cache for port 0222d3a2-c922-4175-b9d9-9962d26eeda7. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:09:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [{"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-842cfb79-eed9-4ad5-9854-73f26e46f435 req-bc51d089-42b8-4aab-8118-4b7544706282 service nova] Releasing lock "refresh_cache-65e21777-de00-4f0a-9774-c1305ac68a43" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:09:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "65e21777-de00-4f0a-9774-c1305ac68a43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:10 user nova-compute[72178]: INFO nova.compute.manager [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Terminating instance
Aug 01 12:09:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:09:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-b6f9920a-03b5-435d-b8ca-ce9ed1bcf464 req-afba74dd-4d60-426a-8f92-67cdd8a28af5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b6f9920a-03b5-435d-b8ca-ce9ed1bcf464 req-afba74dd-4d60-426a-8f92-67cdd8a28af5 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b6f9920a-03b5-435d-b8ca-ce9ed1bcf464 req-afba74dd-4d60-426a-8f92-67cdd8a28af5 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b6f9920a-03b5-435d-b8ca-ce9ed1bcf464 req-afba74dd-4d60-426a-8f92-67cdd8a28af5 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-b6f9920a-03b5-435d-b8ca-ce9ed1bcf464 req-afba74dd-4d60-426a-8f92-67cdd8a28af5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-unplugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-b6f9920a-03b5-435d-b8ca-ce9ed1bcf464 req-afba74dd-4d60-426a-8f92-67cdd8a28af5 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-b03a7486-9cc7-4a8e-957d-c5378638ad26 req-594b60ad-1a19-4e4b-b3ee-603cf42583fe service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b03a7486-9cc7-4a8e-957d-c5378638ad26 req-594b60ad-1a19-4e4b-b3ee-603cf42583fe service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b03a7486-9cc7-4a8e-957d-c5378638ad26 req-594b60ad-1a19-4e4b-b3ee-603cf42583fe service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b03a7486-9cc7-4a8e-957d-c5378638ad26 req-594b60ad-1a19-4e4b-b3ee-603cf42583fe service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-b03a7486-9cc7-4a8e-957d-c5378638ad26 req-594b60ad-1a19-4e4b-b3ee-603cf42583fe service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-unplugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-b03a7486-9cc7-4a8e-957d-c5378638ad26 req-594b60ad-1a19-4e4b-b3ee-603cf42583fe service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-2784e01b-3385-4152-a0a0-455acae3842b req-bb66b408-24f9-4fc6-887b-4cf6391c4ef3 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2784e01b-3385-4152-a0a0-455acae3842b req-bb66b408-24f9-4fc6-887b-4cf6391c4ef3 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2784e01b-3385-4152-a0a0-455acae3842b req-bb66b408-24f9-4fc6-887b-4cf6391c4ef3 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2784e01b-3385-4152-a0a0-455acae3842b req-bb66b408-24f9-4fc6-887b-4cf6391c4ef3 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-2784e01b-3385-4152-a0a0-455acae3842b req-bb66b408-24f9-4fc6-887b-4cf6391c4ef3 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-unplugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-2784e01b-3385-4152-a0a0-455acae3842b req-bb66b408-24f9-4fc6-887b-4cf6391c4ef3 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Instance destroyed successfully.
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lazy-loading 'resources' on Instance uuid 65e21777-de00-4f0a-9774-c1305ac68a43 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:47:d9,bridge_name='br-int',has_traffic_filtering=True,id=0222d3a2-c922-4175-b9d9-9962d26eeda7,network=Network(0135f2c9-2257-4989-add4-bc538ffaf5d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0222d3a2-c9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:47:d9,bridge_name='br-int',has_traffic_filtering=True,id=0222d3a2-c922-4175-b9d9-9962d26eeda7,network=Network(0135f2c9-2257-4989-add4-bc538ffaf5d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0222d3a2-c9') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0222d3a2-c9, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: INFO os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:47:d9,bridge_name='br-int',has_traffic_filtering=True,id=0222d3a2-c922-4175-b9d9-9962d26eeda7,network=Network(0135f2c9-2257-4989-add4-bc538ffaf5d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0222d3a2-c9')
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:49:87,bridge_name='br-int',has_traffic_filtering=True,id=c11d9dd2-2202-4030-83a5-1dbbb3cfe72c,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc11d9dd2-22') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:49:87,bridge_name='br-int',has_traffic_filtering=True,id=c11d9dd2-2202-4030-83a5-1dbbb3cfe72c,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc11d9dd2-22') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc11d9dd2-22, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: INFO os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:49:87,bridge_name='br-int',has_traffic_filtering=True,id=c11d9dd2-2202-4030-83a5-1dbbb3cfe72c,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc11d9dd2-22')
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0654efa4-1f8e-45f5-85fb-07d2749de7d8,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0654efa4-1f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0654efa4-1f8e-45f5-85fb-07d2749de7d8,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0654efa4-1f') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0654efa4-1f, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: INFO os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:03:f0,bridge_name='br-int',has_traffic_filtering=True,id=0654efa4-1f8e-45f5-85fb-07d2749de7d8,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0654efa4-1f')
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:02:59,bridge_name='br-int',has_traffic_filtering=True,id=eeb93cf4-bb8f-4d36-8bd7-8f6211b18396,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb93cf4-bb') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:02:59,bridge_name='br-int',has_traffic_filtering=True,id=eeb93cf4-bb8f-4d36-8bd7-8f6211b18396,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb93cf4-bb') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb93cf4-bb, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: INFO os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:02:59,bridge_name='br-int',has_traffic_filtering=True,id=eeb93cf4-bb8f-4d36-8bd7-8f6211b18396,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb93cf4-bb')
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=38efafbc-6dde-4d99-9210-7231eac9baec,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38efafbc-6d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=38efafbc-6dde-4d99-9210-7231eac9baec,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38efafbc-6d') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38efafbc-6d, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:13 user nova-compute[72178]: INFO os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=38efafbc-6dde-4d99-9210-7231eac9baec,network=Network(62a502cf-d0d7-4833-b77d-f068b140d55a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38efafbc-6d')
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e4:65,bridge_name='br-int',has_traffic_filtering=True,id=10b42e49-0aec-4c43-8007-a256bd95956a,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b42e49-0a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e4:65,bridge_name='br-int',has_traffic_filtering=True,id=10b42e49-0aec-4c43-8007-a256bd95956a,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b42e49-0a') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10b42e49-0a, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:13 user nova-compute[72178]: INFO os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:e4:65,bridge_name='br-int',has_traffic_filtering=True,id=10b42e49-0aec-4c43-8007-a256bd95956a,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10b42e49-0a')
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-01T12:07:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-592278091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-592278091',id=22,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjV97wTvsJQ81Cm3+ulfKyQ/Br2ed+qt4hRWANsDLp+FWoh2u2MBxztgF+yNIvlnEHsLRedn9cbzXfHBcR2pSFsqESuQhZ1lx0ue/esxZ0HDjZVq4UUS5mtTq1dgNfGtA==',key_name='tempest-keypair-359500279',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='772835a74e894918b57dc09ea4aa50f2',ramdisk_id='',reservation_id='r-4g2q62ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-437439604',owner_user_name='tempest-TaggedBootDevicesTest_v242-437439604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:07:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f716d894c2dc4c6b8c73bbb26c8423be',uuid=65e21777-de00-4f0a-9774-c1305ac68a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converting VIF {"id": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "address": "fa:16:3e:6c:22:66", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77ce169c-f4", "ovs_interfaceid": "77ce169c-f4ed-4da4-895f-57f0f1505f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:22:66,bridge_name='br-int',has_traffic_filtering=True,id=77ce169c-f4ed-4da4-895f-57f0f1505f56,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ce169c-f4') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:22:66,bridge_name='br-int',has_traffic_filtering=True,id=77ce169c-f4ed-4da4-895f-57f0f1505f56,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ce169c-f4') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77ce169c-f4, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:13 user nova-compute[72178]: INFO os_vif [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:22:66,bridge_name='br-int',has_traffic_filtering=True,id=77ce169c-f4ed-4da4-895f-57f0f1505f56,network=Network(91b419c9-ba77-41c9-9a52-52e0043a07e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77ce169c-f4')
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'noulMdtC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fddd30-ae5d-48b6-a861-67ea2d6798cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d191726c-2cd2-4534-9051-1b652bd2b7ae]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d459b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc19aaa-5e43-439a-bdce-f6d29482a594]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c052b0-62a0-46d2-af41-f966c5a9ec57]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e256bda6-0187-464b-9b07-c068582e6c3a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[243937e5-287f-45e0-bcfd-dc1e9583d4e0]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d3c737-07a6-48d9-a51d-f79a93c6922f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[89439b49-85d7-4776-b9c0-7ddd02fcff4e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b, portal: 172.16.0.220,3260]
Aug 01 12:09:13 user nova-compute[72178]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b, portal: 172.16.0.220,3260] successful.
Aug 01 12:09:13 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:046fadda-0003-4747-929b-4c5215e18c4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bd3838-9ba7-416f-a945-4c0b844eb352]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== disconnect_volume: return (415ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wFzeJKIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f0edb4-5495-4c40-96b6-bc64b85aa994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[65964e06-2ed2-4f09-b66d-df6ead45672c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd904126e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-0222d3a2-c922-4175-b9d9-9962d26eeda7 for instance with vm_state active and task_state deleting.
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-unplugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-c11d9dd2-2202-4030-83a5-1dbbb3cfe72c for instance with vm_state active and task_state deleting.
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-unplugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING nova.compute.manager [req-dcff8951-158f-473d-bf06-e73c4284d266 req-a9b68082-8e3b-4f7f-94d7-423b2c9ffe5d service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-77ce169c-f4ed-4da4-895f-57f0f1505f56 for instance with vm_state active and task_state deleting.
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[96882154-58f8-43cb-a0f8-dc676660bfdd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-0654efa4-1f8e-45f5-85fb-07d2749de7d8 for instance with vm_state active and task_state deleting.
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-unplugged-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-38efafbc-6dde-4d99-9210-7231eac9baec for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING nova.compute.manager [req-2e354e17-5c0a-46b2-a5e6-3d3cf048f936 req-a5d72937-2f8c-4525-8ad7-0f1dfd290c8e service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-38efafbc-6dde-4d99-9210-7231eac9baec for instance with vm_state active and task_state deleting.
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b06c1d5-a333-42b7-91d5-015a27705830]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe8970f-d5e7-437f-820f-36e416e22d63]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[16edf348-6eb1-4b52-b134-7a2ebc6f0a2f]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[864f2bd1-e357-4763-8d76-d2c0fcbc5b10]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 for instance with vm_state active and task_state deleting.
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-unplugged-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-unplugged-10b42e49-0aec-4c43-8007-a256bd95956a for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Acquiring lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] Lock "65e21777-de00-4f0a-9774-c1305ac68a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] No waiting events found dispatching network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING nova.compute.manager [req-13ff6162-7ac1-4f9f-b000-7208d110c9ee req-5202ae81-b3b2-4a2b-9dda-574cc7e3d983 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received unexpected event network-vif-plugged-10b42e49-0aec-4c43-8007-a256bd95956a for instance with vm_state active and task_state deleting.
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adfdee2-06cc-45f9-934c-e6ab7a457660]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8, portal: 172.16.0.220,3260]
Aug 01 12:09:13 user nova-compute[72178]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8, portal: 172.16.0.220,3260] successful.
Aug 01 12:09:13 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.051s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf5acbe-5cb1-41b2-9fd3-b732f6d058fb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== disconnect_volume: return (398ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSNkwuxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:13 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9683622-d83c-4837-8649-926cc2aeb57a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd916d-01d5-423b-8769-83c8557e5701]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:13 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d45f1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124'): ({'sdf'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Removing single pathed devices sdf {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4812cc4-b413-499b-b707-469f08398625]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba245910-b13e-4c51-963f-bbd867725a92]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Flushing IO for device /dev/sdf {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c341b17-faf6-4839-8ba2-0dd7f3eeb300]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[884dbcf2-4fc2-4adb-9d8d-1129c2086ce7]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[321888c2-0a83-4ad0-9247-f3725fe05a23]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd920495-21dd-4672-9c1d-c9f561db3b45]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124, portal: 172.16.0.220,3260]
Aug 01 12:09:14 user nova-compute[72178]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124, portal: 172.16.0.220,3260] successful.
Aug 01 12:09:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e73d7de4-10a9-4fc8-a9c8-3ee966218124 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[accd29e6-f064-4478-93f3-a980c183f811]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] <== disconnect_volume: return (361ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:09:14 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Deleting instance files /opt/stack/data/nova/instances/65e21777-de00-4f0a-9774-c1305ac68a43_del
Aug 01 12:09:14 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Deletion of /opt/stack/data/nova/instances/65e21777-de00-4f0a-9774-c1305ac68a43_del complete
Aug 01 12:09:14 user nova-compute[72178]: INFO nova.compute.manager [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Took 3.55 seconds to destroy the instance on the hypervisor.
Aug 01 12:09:14 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:09:14 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-d9a2413c-39fe-4c76-b014-946a8f4c1d35 req-f6de31cd-eb2f-4b6b-9411-6c943658a209 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-changed-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-d9a2413c-39fe-4c76-b014-946a8f4c1d35 req-f6de31cd-eb2f-4b6b-9411-6c943658a209 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Refreshing instance network info cache due to event network-changed-56751746-774a-4955-a547-c09eff25e5b5. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d9a2413c-39fe-4c76-b014-946a8f4c1d35 req-f6de31cd-eb2f-4b6b-9411-6c943658a209 service nova] Acquiring lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d9a2413c-39fe-4c76-b014-946a8f4c1d35 req-f6de31cd-eb2f-4b6b-9411-6c943658a209 service nova] Acquired lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG nova.network.neutron [req-d9a2413c-39fe-4c76-b014-946a8f4c1d35 req-f6de31cd-eb2f-4b6b-9411-6c943658a209 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Refreshing network info cache for port 56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'flavor' on Instance uuid 45795fb0-12dd-4acc-990c-d1192e1ab54b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:09:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:17 user nova-compute[72178]: INFO nova.compute.manager [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Attaching volume 538177d7-7465-4a79-97c2-e6184d023b07 to /dev/vdb
Aug 01 12:09:17 user nova-compute[72178]: DEBUG os_brick.utils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce29b58-c46e-4f82-aff6-0ce8c3d3f76c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f8891-284e-4f68-ac84-1922b16deb1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae3c72f-f8ca-470a-9a09-39f7768f751f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b3d27d-3008-4d7c-8f6e-53a9c2052200]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:09:17 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[086cf335-0f91-4ec1-aa5b-970de14aec27]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG os_brick.utils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Updating existing volume attachment record: 25e0dd25-7e86-4cce-aebb-4ee849b81a59 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-d9a2413c-39fe-4c76-b014-946a8f4c1d35 req-f6de31cd-eb2f-4b6b-9411-6c943658a209 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Updated VIF entry in instance network info cache for port 56751746-774a-4955-a547-c09eff25e5b5. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-d9a2413c-39fe-4c76-b014-946a8f4c1d35 req-f6de31cd-eb2f-4b6b-9411-6c943658a209 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Updating instance_info_cache with network_info: [{"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d9a2413c-39fe-4c76-b014-946a8f4c1d35 req-f6de31cd-eb2f-4b6b-9411-6c943658a209 service nova] Releasing lock "refresh_cache-45795fb0-12dd-4acc-990c-d1192e1ab54b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:09:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:18 user nova-compute[72178]: INFO nova.compute.manager [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] instance snapshotting
Aug 01 12:09:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Beginning live snapshot process
Aug 01 12:09:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-cd5d46a1-bd5f-4424-bcf8-865c3cc8939b req-7ad3496b-b6c4-4b5f-8a14-c264c1798c13 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-deleted-77ce169c-f4ed-4da4-895f-57f0f1505f56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:18 user nova-compute[72178]: INFO nova.compute.manager [req-cd5d46a1-bd5f-4424-bcf8-865c3cc8939b req-7ad3496b-b6c4-4b5f-8a14-c264c1798c13 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Neutron deleted interface 77ce169c-f4ed-4da4-895f-57f0f1505f56; detaching it from the instance and deleting it from the info cache
Aug 01 12:09:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-cd5d46a1-bd5f-4424-bcf8-865c3cc8939b req-7ad3496b-b6c4-4b5f-8a14-c264c1798c13 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [{"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10b42e49-0aec-4c43-8007-a256bd95956a", "address": "fa:16:3e:bb:e4:65", "network": {"id": "91b419c9-ba77-41c9-9a52-52e0043a07e2", "bridge": "br-int", "label": "tempest-device-tagging-net2-987969365", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10b42e49-0a", "ovs_interfaceid": "10b42e49-0aec-4c43-8007-a256bd95956a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-cd5d46a1-bd5f-4424-bcf8-865c3cc8939b req-7ad3496b-b6c4-4b5f-8a14-c264c1798c13 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Detach interface failed, port_id=77ce169c-f4ed-4da4-895f-57f0f1505f56, reason: Instance 65e21777-de00-4f0a-9774-c1305ac68a43 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:09:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-cd5d46a1-bd5f-4424-bcf8-865c3cc8939b req-7ad3496b-b6c4-4b5f-8a14-c264c1798c13 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-deleted-10b42e49-0aec-4c43-8007-a256bd95956a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:18 user nova-compute[72178]: INFO nova.compute.manager [req-cd5d46a1-bd5f-4424-bcf8-865c3cc8939b req-7ad3496b-b6c4-4b5f-8a14-c264c1798c13 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Neutron deleted interface 10b42e49-0aec-4c43-8007-a256bd95956a; detaching it from the instance and deleting it from the info cache
Aug 01 12:09:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-cd5d46a1-bd5f-4424-bcf8-865c3cc8939b req-7ad3496b-b6c4-4b5f-8a14-c264c1798c13 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [{"id": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "address": "fa:16:3e:79:47:d9", "network": {"id": "0135f2c9-2257-4989-add4-bc538ffaf5d8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-583729083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0222d3a2-c9", "ovs_interfaceid": "0222d3a2-c922-4175-b9d9-9962d26eeda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-cd5d46a1-bd5f-4424-bcf8-865c3cc8939b req-7ad3496b-b6c4-4b5f-8a14-c264c1798c13 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Detach interface failed, port_id=10b42e49-0aec-4c43-8007-a256bd95956a, reason: Instance 65e21777-de00-4f0a-9774-c1305ac68a43 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:09:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json -f qcow2 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json -f qcow2 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp38iwwps9/268d03f9051c4e84b4a6272c860018d5.delta 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp38iwwps9/268d03f9051c4e84b4a6272c860018d5.delta 1073741824" returned: 0 in 0.064s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 12:09:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:09:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-deleted-0222d3a2-c922-4175-b9d9-9962d26eeda7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:20 user nova-compute[72178]: INFO nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Neutron deleted interface 0222d3a2-c922-4175-b9d9-9962d26eeda7; detaching it from the instance and deleting it from the info cache
Aug 01 12:09:20 user nova-compute[72178]: DEBUG nova.network.neutron [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [{"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "address": "fa:16:3e:33:02:59", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb93cf4-bb", "ovs_interfaceid": "eeb93cf4-bb8f-4d36-8bd7-8f6211b18396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] COPY block job progress, current cursor: 12451840 final cursor: 75497472 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Detach interface failed, port_id=0222d3a2-c922-4175-b9d9-9962d26eeda7, reason: Instance 65e21777-de00-4f0a-9774-c1305ac68a43 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-deleted-eeb93cf4-bb8f-4d36-8bd7-8f6211b18396 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:21 user nova-compute[72178]: INFO nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Neutron deleted interface eeb93cf4-bb8f-4d36-8bd7-8f6211b18396; detaching it from the instance and deleting it from the info cache
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.network.neutron [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [{"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "38efafbc-6dde-4d99-9210-7231eac9baec", "address": "fa:16:3e:87:33:c2", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38efafbc-6d", "ovs_interfaceid": "38efafbc-6dde-4d99-9210-7231eac9baec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:21 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Took 6.80 seconds to deallocate network for instance.
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Detach interface failed, port_id=eeb93cf4-bb8f-4d36-8bd7-8f6211b18396, reason: Instance 65e21777-de00-4f0a-9774-c1305ac68a43 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Received event network-vif-deleted-38efafbc-6dde-4d99-9210-7231eac9baec {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:21 user nova-compute[72178]: INFO nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Neutron deleted interface 38efafbc-6dde-4d99-9210-7231eac9baec; detaching it from the instance and deleting it from the info cache
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.network.neutron [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Updating instance_info_cache with network_info: [{"id": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "address": "fa:16:3e:8f:49:87", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc11d9dd2-22", "ovs_interfaceid": "c11d9dd2-2202-4030-83a5-1dbbb3cfe72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "address": "fa:16:3e:1f:03:f0", "network": {"id": "62a502cf-d0d7-4833-b77d-f068b140d55a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1248213846", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.188", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "772835a74e894918b57dc09ea4aa50f2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0654efa4-1f", "ovs_interfaceid": "0654efa4-1f8e-45f5-85fb-07d2749de7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-1072e03f-e7ec-438b-9ece-22102697ab58 req-7c065e33-bb73-433c-ac6e-50550988bed1 service nova] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Detach interface failed, port_id=38efafbc-6dde-4d99-9210-7231eac9baec, reason: Instance 65e21777-de00-4f0a-9774-c1305ac68a43 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:09:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] COPY block job progress, current cursor: 35586048 final cursor: 75497472 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:09:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:09:22 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 12:09:22 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:09:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp38iwwps9/268d03f9051c4e84b4a6272c860018d5.delta /opt/stack/data/nova/instances/snapshots/tmp38iwwps9/268d03f9051c4e84b4a6272c860018d5 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp38iwwps9/268d03f9051c4e84b4a6272c860018d5.delta /opt/stack/data/nova/instances/snapshots/tmp38iwwps9/268d03f9051c4e84b4a6272c860018d5" returned: 0 in 0.846s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:23 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Snapshot extracted, beginning image upload
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.volume.cinder [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Update attachment failed for attachment 25e0dd25-7e86-4cce-aebb-4ee849b81a59. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 was not found.).). (HTTP 500) (Request-ID: req-437683db-cb12-478d-a014-5b61ffccc579) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 was not found.).). (HTTP 500) (Request-ID: req-437683db-cb12-478d-a014-5b61ffccc579)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Failed to attach 538177d7-7465-4a79-97c2-e6184d023b07 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 was not found.).). (HTTP 500) (Request-ID: req-437683db-cb12-478d-a014-5b61ffccc579)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Traceback (most recent call last):
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     ret_val = method(obj, context, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     self._do_attach(context, instance, volume, volume_api,
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     self._volume_attach(context, volume, connector, instance,
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     connection_info = volume_api.attachment_update(
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     res = method(self, ctx, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     with excutils.save_and_reraise_exception():
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     self.force_reraise()
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     raise self.value
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     context, '3.44', skip_version_check=True).attachments.update(
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     return method.func(obj, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     resp = self._update('/attachments/%s' % id, body)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     return self._cs_request(url, 'PUT', **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     return self.request(url, method, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b]     raise exceptions.from_response(resp, body)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 was not found.).). (HTTP 500) (Request-ID: req-437683db-cb12-478d-a014-5b61ffccc579)
Aug 01 12:09:23 user nova-compute[72178]: ERROR nova.compute.manager [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] 
Aug 01 12:09:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.612s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server [None req-6809ea78-6ef4-430c-aa90-a76de237c1ee tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 was not found.).). (HTTP 500) (Request-ID: req-437683db-cb12-478d-a014-5b61ffccc579)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 318, in _update
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 226, in put
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:538177d7-7465-4a79-97c2-e6184d023b07/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4f17261c-e322-48ac-be2c-700108c830a8 was not found.).). (HTTP 500) (Request-ID: req-437683db-cb12-478d-a014-5b61ffccc579)
Aug 01 12:09:23 user nova-compute[72178]: ERROR oslo_messaging.rpc.server 
Aug 01 12:09:24 user nova-compute[72178]: INFO nova.compute.manager [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Took 3.18 seconds to detach 3 volumes for instance.
Aug 01 12:09:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:24 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:09:24 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:09:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:24 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Deleted allocations for instance 65e21777-de00-4f0a-9774-c1305ac68a43
Aug 01 12:09:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e1faa10-91c3-41b7-b312-ea766a1fa696 tempest-TaggedBootDevicesTest_v242-437439604 tempest-TaggedBootDevicesTest_v242-437439604-project-member] Lock "65e21777-de00-4f0a-9774-c1305ac68a43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.324s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:25 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Snapshot image upload complete
Aug 01 12:09:25 user nova-compute[72178]: INFO nova.compute.manager [None req-4ab6bcd4-bdee-4646-87bf-9a46f608efd0 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Took 7.30 seconds to snapshot the instance on the hypervisor.
Aug 01 12:09:27 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891752.592261, 65e21777-de00-4f0a-9774-c1305ac68a43 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:09:27 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] VM Stopped (Lifecycle Event)
Aug 01 12:09:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-807df00c-e5e0-4d85-a8d1-361628509076 None None] [instance: 65e21777-de00-4f0a-9774-c1305ac68a43] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:31 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:09:32 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updating instance_info_cache with network_info: [{"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-326f0759-29ce-4441-ba2a-7a74d8726eb7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:09:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:09:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:09:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:36 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-b7d5dfec-caff-4cb1-a949-afe068c3d836 req-3d9fb05a-cf88-4512-a41f-84561b34ea34 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-changed-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-b7d5dfec-caff-4cb1-a949-afe068c3d836 req-3d9fb05a-cf88-4512-a41f-84561b34ea34 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Refreshing instance network info cache due to event network-changed-326dc903-e97e-4cde-bd42-5145785c4f92. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7d5dfec-caff-4cb1-a949-afe068c3d836 req-3d9fb05a-cf88-4512-a41f-84561b34ea34 service nova] Acquiring lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7d5dfec-caff-4cb1-a949-afe068c3d836 req-3d9fb05a-cf88-4512-a41f-84561b34ea34 service nova] Acquired lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG nova.network.neutron [req-b7d5dfec-caff-4cb1-a949-afe068c3d836 req-3d9fb05a-cf88-4512-a41f-84561b34ea34 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Refreshing network info cache for port 326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG nova.network.neutron [req-b7d5dfec-caff-4cb1-a949-afe068c3d836 req-3d9fb05a-cf88-4512-a41f-84561b34ea34 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updated VIF entry in instance network info cache for port 326dc903-e97e-4cde-bd42-5145785c4f92. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG nova.network.neutron [req-b7d5dfec-caff-4cb1-a949-afe068c3d836 req-3d9fb05a-cf88-4512-a41f-84561b34ea34 service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7d5dfec-caff-4cb1-a949-afe068c3d836 req-3d9fb05a-cf88-4512-a41f-84561b34ea34 service nova] Releasing lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:39 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:09:39 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=6793MB free_disk=25.179744720458984GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Stashing vm_state: active {{(pid=72178) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-67fbe9c3-96f5-484d-a277-efa64dc29552 req-39a3eefa-7fad-4ba6-837e-bbee0f595f3d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-changed-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-67fbe9c3-96f5-484d-a277-efa64dc29552 req-39a3eefa-7fad-4ba6-837e-bbee0f595f3d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Refreshing instance network info cache due to event network-changed-29efbfad-3acd-4d72-977a-776ed80c3b47. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-67fbe9c3-96f5-484d-a277-efa64dc29552 req-39a3eefa-7fad-4ba6-837e-bbee0f595f3d service nova] Acquiring lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-67fbe9c3-96f5-484d-a277-efa64dc29552 req-39a3eefa-7fad-4ba6-837e-bbee0f595f3d service nova] Acquired lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-67fbe9c3-96f5-484d-a277-efa64dc29552 req-39a3eefa-7fad-4ba6-837e-bbee0f595f3d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Refreshing network info cache for port 29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:09:39 user nova-compute[72178]: INFO nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating resource usage from migration f592cebb-998a-424c-801f-37467ff955a3
Aug 01 12:09:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f4ae1965-8660-4deb-8427-cafa57f837c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 69cbbc9f-ec82-4a40-9f91-3941db5088e4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 45795fb0-12dd-4acc-990c-d1192e1ab54b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 0fcffdc5-2321-4287-a89e-d3b7675e19f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance c2b7b3b8-1ed3-4754-9699-16839c7394c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Migration f592cebb-998a-424c-801f-37467ff955a3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e7e1d3fe-99fe-41fe-bff7-5ea191c529de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-67fbe9c3-96f5-484d-a277-efa64dc29552 req-39a3eefa-7fad-4ba6-837e-bbee0f595f3d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updated VIF entry in instance network info cache for port 29efbfad-3acd-4d72-977a-776ed80c3b47. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-67fbe9c3-96f5-484d-a277-efa64dc29552 req-39a3eefa-7fad-4ba6-837e-bbee0f595f3d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating instance_info_cache with network_info: [{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-67fbe9c3-96f5-484d-a277-efa64dc29552 req-39a3eefa-7fad-4ba6-837e-bbee0f595f3d service nova] Releasing lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.741s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.586s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'pci_requests' on Instance uuid e7e1d3fe-99fe-41fe-bff7-5ea191c529de {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:09:40 user nova-compute[72178]: INFO nova.compute.claims [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Claim successful on node user
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'resources' on Instance uuid e7e1d3fe-99fe-41fe-bff7-5ea191c529de {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'pci_devices' on Instance uuid e7e1d3fe-99fe-41fe-bff7-5ea191c529de {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:09:40 user nova-compute[72178]: INFO nova.compute.resource_tracker [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating resource usage from migration f592cebb-998a-424c-801f-37467ff955a3
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=72178) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.568s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:40 user nova-compute[72178]: INFO nova.compute.manager [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Migrating
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquired lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:09:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating instance_info_cache with network_info: [{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Releasing lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Starting migrate_disk_and_power_off {{(pid=72178) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] There are 0 instances to clean {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-4ba248eb-c750-4f40-a5ca-8d14d5ce93d4 req-9e828dae-9ee7-4554-a955-2295ec01248f service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-unplugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4ba248eb-c750-4f40-a5ca-8d14d5ce93d4 req-9e828dae-9ee7-4554-a955-2295ec01248f service nova] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4ba248eb-c750-4f40-a5ca-8d14d5ce93d4 req-9e828dae-9ee7-4554-a955-2295ec01248f service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4ba248eb-c750-4f40-a5ca-8d14d5ce93d4 req-9e828dae-9ee7-4554-a955-2295ec01248f service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-4ba248eb-c750-4f40-a5ca-8d14d5ce93d4 req-9e828dae-9ee7-4554-a955-2295ec01248f service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] No waiting events found dispatching network-vif-unplugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:41 user nova-compute[72178]: WARNING nova.compute.manager [req-4ba248eb-c750-4f40-a5ca-8d14d5ce93d4 req-9e828dae-9ee7-4554-a955-2295ec01248f service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received unexpected event network-vif-unplugged-29efbfad-3acd-4d72-977a-776ed80c3b47 for instance with vm_state active and task_state resize_migrating.
Aug 01 12:09:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:42 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance destroyed successfully.
Aug 01 12:09:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83603559',display_name='tempest-ServerActionsTestOtherA-server-83603559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83603559',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:08:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-4nops17y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:09:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=e7e1d3fe-99fe-41fe-bff7-5ea191c529de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-407065071-network", "vif_mac": "fa:16:3e:be:52:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-407065071-network", "vif_mac": "fa:16:3e:be:52:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_vif [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29efbfad-3a, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:42 user nova-compute[72178]: INFO os_vif [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a')
Aug 01 12:09:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXWOLGuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:42 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2eac1-b5ac-4038-9460-5b06bea4ec67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78eac5f-0c93-4e14-a706-f4117bd4b442]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:42 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:42 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:42 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f412dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'): ({'sdg'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Removing single pathed devices sdg {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9a7a05-4015-4dcd-88cc-b94d81a3b091]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53926d7-7b43-4821-a701-e76336694e69]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flushing IO for device /dev/sdg {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c41bfe-4c89-49fe-bf7c-2d37162877af]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb91f1d-6c63-4d8c-bc0a-fa2670c49857]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] SCSI volumes sdg have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb22a84-dd6e-40c8-a46c-b9f7d8253f92]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05891dd-7a1d-4c19-b1fd-a465bbd2e1f1]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260]
Aug 01 12:09:42 user nova-compute[72178]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260] successful.
Aug 01 12:09:42 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7e03bd-0938-49f7-b1a4-d313d7f723d8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== disconnect_volume: return (337ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:09:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Port 29efbfad-3acd-4d72-977a-776ed80c3b47 binding to destination host user is already ACTIVE {{(pid=72178) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquired lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-33ba0328-bd4b-4316-a2fe-8ea1940c1aed req-77cfaaf6-281c-4b21-8751-173b57ab7fe4 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-33ba0328-bd4b-4316-a2fe-8ea1940c1aed req-77cfaaf6-281c-4b21-8751-173b57ab7fe4 service nova] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-33ba0328-bd4b-4316-a2fe-8ea1940c1aed req-77cfaaf6-281c-4b21-8751-173b57ab7fe4 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-33ba0328-bd4b-4316-a2fe-8ea1940c1aed req-77cfaaf6-281c-4b21-8751-173b57ab7fe4 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-33ba0328-bd4b-4316-a2fe-8ea1940c1aed req-77cfaaf6-281c-4b21-8751-173b57ab7fe4 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] No waiting events found dispatching network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:43 user nova-compute[72178]: WARNING nova.compute.manager [req-33ba0328-bd4b-4316-a2fe-8ea1940c1aed req-77cfaaf6-281c-4b21-8751-173b57ab7fe4 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received unexpected event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 for instance with vm_state active and task_state resize_migrated.
Aug 01 12:09:44 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating instance_info_cache with network_info: [{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Releasing lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG os_brick.utils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d9a11-d4dc-4c68-a500-05a7b86da8db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc218e1-f3a4-42bc-9ce5-568e2231d2ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee5fd0c-b336-408e-966e-d27dacfd0d5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c446b847-97ce-49f8-8ae9-be53fd8d605b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:09:44 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:09:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d185ffc3-1520-4086-ab75-f6601b7e3e4f]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:09:44 user nova-compute[72178]: DEBUG os_brick.utils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:48 user nova-compute[72178]: INFO nova.compute.manager [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Terminating instance
Aug 01 12:09:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-08ef143b-7644-4277-90f5-5f6592e4fc1f req-cbefe1af-03b1-4b8c-8c5f-087118e15772 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received event network-vif-unplugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-08ef143b-7644-4277-90f5-5f6592e4fc1f req-cbefe1af-03b1-4b8c-8c5f-087118e15772 service nova] Acquiring lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-08ef143b-7644-4277-90f5-5f6592e4fc1f req-cbefe1af-03b1-4b8c-8c5f-087118e15772 service nova] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-08ef143b-7644-4277-90f5-5f6592e4fc1f req-cbefe1af-03b1-4b8c-8c5f-087118e15772 service nova] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-08ef143b-7644-4277-90f5-5f6592e4fc1f req-cbefe1af-03b1-4b8c-8c5f-087118e15772 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] No waiting events found dispatching network-vif-unplugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-08ef143b-7644-4277-90f5-5f6592e4fc1f req-cbefe1af-03b1-4b8c-8c5f-087118e15772 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received event network-vif-unplugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:09:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Instance destroyed successfully.
Aug 01 12:09:49 user nova-compute[72178]: DEBUG nova.objects.instance [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'resources' on Instance uuid 0fcffdc5-2321-4287-a89e-d3b7675e19f3 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1089155580',display_name='tempest-TestVolumeBootPattern-server-1089155580',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1089155580',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:08:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-fewdfe57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:08:20Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=0fcffdc5-2321-4287-a89e-d3b7675e19f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "address": "fa:16:3e:53:b8:f0", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d50a070-54", "ovs_interfaceid": "8d50a070-54b3-443d-b54c-43c4a7f3dbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:b8:f0,bridge_name='br-int',has_traffic_filtering=True,id=8d50a070-54b3-443d-b54c-43c4a7f3dbcf,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d50a070-54') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_vif [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b8:f0,bridge_name='br-int',has_traffic_filtering=True,id=8d50a070-54b3-443d-b54c-43c4a7f3dbcf,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d50a070-54') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d50a070-54, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:49 user nova-compute[72178]: INFO os_vif [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:b8:f0,bridge_name='br-int',has_traffic_filtering=True,id=8d50a070-54b3-443d-b54c-43c4a7f3dbcf,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d50a070-54')
Aug 01 12:09:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbWdmiyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:49 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5bbde6-62e3-48fe-b4d3-763342693e69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8447643-1526-4e1c-8019-1e9e2590fc69]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:49 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:49 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:49 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:49 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:49 user nova-compute[72178]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 (non-flash)
Aug 01 12:09:49 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:49 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:49 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd906e74ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb7e1f1-56d3-49c8-9d98-0986b51dfe80]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[68be02fa-da7e-4abe-b950-4be096bc3df5]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7576f1-bc26-4608-99a7-67eeba3c0979]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f3b08-7857-48d2-bd7b-a78bbeb025df]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOea349ff1-fa62923ec4c6e1ad', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ea349ff1', '/dev/disk/by-id/scsi-26661363239323365') {{(pid=83857) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 12:09:49 user nova-compute[72178]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOea349ff1-fa62923ec4c6e1ad
Aug 01 12:09:49 user nova-compute[72178]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ea349ff1
Aug 01 12:09:49 user nova-compute[72178]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26661363239323365
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee29b5c5-ef40-402d-b61a-6ac39b5ce08c]: (4, None) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16df449-9705-40d7-8a19-334c5193ca83]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70a21ba-2af0-4bcc-bf4c-d8eb3af5f0b0]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840, portal: 172.16.0.220,3260]
Aug 01 12:09:49 user nova-compute[72178]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840, portal: 172.16.0.220,3260] successful.
Aug 01 12:09:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54f0b62b-b837-4a52-bcb2-cb41901b0840 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f129d3b3-2af9-4316-a2d6-9cc5fa17bdf9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== disconnect_volume: return (313ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:09:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Deleting instance files /opt/stack/data/nova/instances/0fcffdc5-2321-4287-a89e-d3b7675e19f3_del
Aug 01 12:09:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Deletion of /opt/stack/data/nova/instances/0fcffdc5-2321-4287-a89e-d3b7675e19f3_del complete
Aug 01 12:09:49 user nova-compute[72178]: INFO nova.compute.manager [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 01 12:09:49 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:09:49 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:09:50 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:09:50 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Took 0.86 seconds to deallocate network for instance.
Aug 01 12:09:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-58b4806e-73a2-417b-8e64-88daefd50f83 req-bb4b284c-1e3c-4bc1-8fda-83cad94dd874 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received event network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-58b4806e-73a2-417b-8e64-88daefd50f83 req-bb4b284c-1e3c-4bc1-8fda-83cad94dd874 service nova] Acquiring lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-58b4806e-73a2-417b-8e64-88daefd50f83 req-bb4b284c-1e3c-4bc1-8fda-83cad94dd874 service nova] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-58b4806e-73a2-417b-8e64-88daefd50f83 req-bb4b284c-1e3c-4bc1-8fda-83cad94dd874 service nova] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-58b4806e-73a2-417b-8e64-88daefd50f83 req-bb4b284c-1e3c-4bc1-8fda-83cad94dd874 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] No waiting events found dispatching network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:50 user nova-compute[72178]: WARNING nova.compute.manager [req-58b4806e-73a2-417b-8e64-88daefd50f83 req-bb4b284c-1e3c-4bc1-8fda-83cad94dd874 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received unexpected event network-vif-plugged-8d50a070-54b3-443d-b54c-43c4a7f3dbcf for instance with vm_state active and task_state deleting.
Aug 01 12:09:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-58b4806e-73a2-417b-8e64-88daefd50f83 req-bb4b284c-1e3c-4bc1-8fda-83cad94dd874 service nova] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Received event network-vif-deleted-8d50a070-54b3-443d-b54c-43c4a7f3dbcf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:51 user nova-compute[72178]: INFO nova.compute.manager [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Took 0.77 seconds to detach 1 volumes for instance.
Aug 01 12:09:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Deleting volume: 54f0b62b-b837-4a52-bcb2-cb41901b0840 {{(pid=72178) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 12:09:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:51 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:09:51 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:09:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:51 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Deleted allocations for instance 0fcffdc5-2321-4287-a89e-d3b7675e19f3
Aug 01 12:09:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-806b156b-be41-4cc4-9160-a5a2497962db tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "0fcffdc5-2321-4287-a89e-d3b7675e19f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.644s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Starting finish_migration {{(pid=72178) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance directory exists: not creating {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 12:09:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Creating image(s)
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Ensure instance console log exists: /opt/stack/data/nova/instances/e7e1d3fe-99fe-41fe-bff7-5ea191c529de/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Start _get_guest_xml network_info=[{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-407065071-network", "vif_mac": "fa:16:3e:be:52:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXWOLGuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e7e1d3fe-99fe-41fe-bff7-5ea191c529de', 'attached_at': '2023-08-01T12:09:52.000000', 'detached_at': '', 'volume_id': '1aaa80a6-89bc-4172-bdd7-6f6ab3e17987', 'serial': '1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'}, 'boot_index': 0, 'attachment_id': '4225b9cc-d89b-4c34-8b72-33d26a5c0f08', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:09:52 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:09:52 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7e1d3fe-99fe-41fe-bff7-5ea191c529de {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXWOLGuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:09:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:09:52 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05f5e55-4ee6-4bf1-88e8-6a2db9f5f1d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:09:52 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb1f0ba-8461-410c-91f7-18cad4f1dc26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987] added
Aug 01 12:09:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ab7fd2-e8d3-4d55-aea2-aefa1a05419a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c50deb-21da-4dbd-bc1a-c505b95bacc3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXWOLGuf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nXWOLGuf" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e3404d-b37a-4949-9b4c-5b084dbbe4dd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nXWOLGuf'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb183039-9be7-4c7f-b00d-ad19e96bb05d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe73a2e-0c61-4c42-a8ed-76f1f03b0504]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:52 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:52 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:52 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:52 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:52 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:52 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[626fe69b-3570-48a2-bcb6-f0ef50d9f260]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260]
Aug 01 12:09:53 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260] successful.
Aug 01 12:09:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f0805d-e1f3-4dc4-84f8-b5a5e2f3e5f7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5316d32-06e3-44d2-8dc9-7cdcd22b634e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:53 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:53 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:53 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:53 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:09:53 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:09:53 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:09:53 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:09:53 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:09:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ca4cc9-9daa-438b-970d-665f3e72c9b8]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:09:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXWOLGuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26334376434653335', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334376434653335', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83603559',display_name='tempest-ServerActionsTestOtherA-server-83603559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83603559',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:08:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-4nops17y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=e7e1d3fe-99fe-41fe-bff7-5ea191c529de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-407065071-network", "vif_mac": "fa:16:3e:be:52:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-407065071-network", "vif_mac": "fa:16:3e:be:52:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:09:54 user nova-compute[72178]:   <uuid>e7e1d3fe-99fe-41fe-bff7-5ea191c529de</uuid>
Aug 01 12:09:54 user nova-compute[72178]:   <name>instance-00000019</name>
Aug 01 12:09:54 user nova-compute[72178]:   <memory>2097152</memory>
Aug 01 12:09:54 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:09:54 user nova-compute[72178]:   <metadata>
Aug 01 12:09:54 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:09:54 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:09:54 user nova-compute[72178]:       <nova:name>tempest-ServerActionsTestOtherA-server-83603559</nova:name>
Aug 01 12:09:54 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:09:52</nova:creationTime>
Aug 01 12:09:54 user nova-compute[72178]:       <nova:flavor name="m1.small">
Aug 01 12:09:54 user nova-compute[72178]:         <nova:memory>2048</nova:memory>
Aug 01 12:09:54 user nova-compute[72178]:         <nova:disk>20</nova:disk>
Aug 01 12:09:54 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:09:54 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:09:54 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:09:54 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:09:54 user nova-compute[72178]:       <nova:owner>
Aug 01 12:09:54 user nova-compute[72178]:         <nova:user uuid="5bc4265e5e5a4c50b76f755a048af7b4">tempest-ServerActionsTestOtherA-709464081-project-member</nova:user>
Aug 01 12:09:54 user nova-compute[72178]:         <nova:project uuid="c4c619872deb42eca689576a995b252e">tempest-ServerActionsTestOtherA-709464081</nova:project>
Aug 01 12:09:54 user nova-compute[72178]:       </nova:owner>
Aug 01 12:09:54 user nova-compute[72178]:       <nova:ports>
Aug 01 12:09:54 user nova-compute[72178]:         <nova:port uuid="29efbfad-3acd-4d72-977a-776ed80c3b47">
Aug 01 12:09:54 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 12:09:54 user nova-compute[72178]:         </nova:port>
Aug 01 12:09:54 user nova-compute[72178]:       </nova:ports>
Aug 01 12:09:54 user nova-compute[72178]:     </nova:instance>
Aug 01 12:09:54 user nova-compute[72178]:   </metadata>
Aug 01 12:09:54 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:09:54 user nova-compute[72178]:     <system>
Aug 01 12:09:54 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:09:54 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:09:54 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:09:54 user nova-compute[72178]:       <entry name="serial">e7e1d3fe-99fe-41fe-bff7-5ea191c529de</entry>
Aug 01 12:09:54 user nova-compute[72178]:       <entry name="uuid">e7e1d3fe-99fe-41fe-bff7-5ea191c529de</entry>
Aug 01 12:09:54 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:09:54 user nova-compute[72178]:     </system>
Aug 01 12:09:54 user nova-compute[72178]:   </sysinfo>
Aug 01 12:09:54 user nova-compute[72178]:   <os>
Aug 01 12:09:54 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:09:54 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:09:54 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:09:54 user nova-compute[72178]:   </os>
Aug 01 12:09:54 user nova-compute[72178]:   <features>
Aug 01 12:09:54 user nova-compute[72178]:     <acpi/>
Aug 01 12:09:54 user nova-compute[72178]:     <apic/>
Aug 01 12:09:54 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:09:54 user nova-compute[72178]:   </features>
Aug 01 12:09:54 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:09:54 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:09:54 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:09:54 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:09:54 user nova-compute[72178]:   </clock>
Aug 01 12:09:54 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:09:54 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:09:54 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:09:54 user nova-compute[72178]:   </cpu>
Aug 01 12:09:54 user nova-compute[72178]:   <devices>
Aug 01 12:09:54 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:09:54 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:09:54 user nova-compute[72178]:       <source dev="/dev/sdc"/>
Aug 01 12:09:54 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:09:54 user nova-compute[72178]:       <serial>1aaa80a6-89bc-4172-bdd7-6f6ab3e17987</serial>
Aug 01 12:09:54 user nova-compute[72178]:     </disk>
Aug 01 12:09:54 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:09:54 user nova-compute[72178]:       <mac address="fa:16:3e:be:52:74"/>
Aug 01 12:09:54 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:09:54 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:09:54 user nova-compute[72178]:       <target dev="tap29efbfad-3a"/>
Aug 01 12:09:54 user nova-compute[72178]:     </interface>
Aug 01 12:09:54 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:09:54 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/e7e1d3fe-99fe-41fe-bff7-5ea191c529de/console.log" append="off"/>
Aug 01 12:09:54 user nova-compute[72178]:     </serial>
Aug 01 12:09:54 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:09:54 user nova-compute[72178]:     <video>
Aug 01 12:09:54 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:09:54 user nova-compute[72178]:     </video>
Aug 01 12:09:54 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:09:54 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:09:54 user nova-compute[72178]:     </rng>
Aug 01 12:09:54 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:09:54 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:09:54 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:09:54 user nova-compute[72178]:     </memballoon>
Aug 01 12:09:54 user nova-compute[72178]:   </devices>
Aug 01 12:09:54 user nova-compute[72178]: </domain>
Aug 01 12:09:54 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83603559',display_name='tempest-ServerActionsTestOtherA-server-83603559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83603559',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:08:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-4nops17y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=e7e1d3fe-99fe-41fe-bff7-5ea191c529de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-407065071-network", "vif_mac": "fa:16:3e:be:52:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-407065071-network", "vif_mac": "fa:16:3e:be:52:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG os_vif [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29efbfad-3a, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29efbfad-3a, col_values=(('external_ids', {'iface-id': '29efbfad-3acd-4d72-977a-776ed80c3b47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:52:74', 'vm-uuid': 'e7e1d3fe-99fe-41fe-bff7-5ea191c529de'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:54 user nova-compute[72178]: INFO os_vif [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a')
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:09:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] No VIF found with MAC fa:16:3e:be:52:74, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-de3258ea-8ca2-4b57-8967-5328ff46b119 req-d92bc42c-8333-45cf-88f9-6c6ad3ca239d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3258ea-8ca2-4b57-8967-5328ff46b119 req-d92bc42c-8333-45cf-88f9-6c6ad3ca239d service nova] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3258ea-8ca2-4b57-8967-5328ff46b119 req-d92bc42c-8333-45cf-88f9-6c6ad3ca239d service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3258ea-8ca2-4b57-8967-5328ff46b119 req-d92bc42c-8333-45cf-88f9-6c6ad3ca239d service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-de3258ea-8ca2-4b57-8967-5328ff46b119 req-d92bc42c-8333-45cf-88f9-6c6ad3ca239d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] No waiting events found dispatching network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:55 user nova-compute[72178]: WARNING nova.compute.manager [req-de3258ea-8ca2-4b57-8967-5328ff46b119 req-d92bc42c-8333-45cf-88f9-6c6ad3ca239d service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received unexpected event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 for instance with vm_state active and task_state resize_finish.
Aug 01 12:09:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891782.234061, e7e1d3fe-99fe-41fe-bff7-5ea191c529de => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:09:57 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] VM Stopped (Lifecycle Event)
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3eac2d19-b018-4373-8e9a-d0ce692343a4 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891797.7722352, e7e1d3fe-99fe-41fe-bff7-5ea191c529de => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:09:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] VM Resumed (Lifecycle Event)
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:09:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance running successfully.
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Failed to set time: agent not configured {{(pid=72178) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6c862dc0-c87c-4e04-9750-75c3515184a9 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] finish_migration finished successfully. {{(pid=72178) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:09:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891797.7757854, e7e1d3fe-99fe-41fe-bff7-5ea191c529de => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:09:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] VM Started (Lifecycle Event)
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:09:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-470fe37a-9047-4250-9723-2e81e9e683ea req-1ac5a95e-36db-4835-8241-d311b2e928f5 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-470fe37a-9047-4250-9723-2e81e9e683ea req-1ac5a95e-36db-4835-8241-d311b2e928f5 service nova] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-470fe37a-9047-4250-9723-2e81e9e683ea req-1ac5a95e-36db-4835-8241-d311b2e928f5 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-470fe37a-9047-4250-9723-2e81e9e683ea req-1ac5a95e-36db-4835-8241-d311b2e928f5 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:09:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-470fe37a-9047-4250-9723-2e81e9e683ea req-1ac5a95e-36db-4835-8241-d311b2e928f5 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] No waiting events found dispatching network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:09:57 user nova-compute[72178]: WARNING nova.compute.manager [req-470fe37a-9047-4250-9723-2e81e9e683ea req-1ac5a95e-36db-4835-8241-d311b2e928f5 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received unexpected event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 for instance with vm_state active and task_state resize_finish.
Aug 01 12:09:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:01 user nova-compute[72178]: INFO nova.compute.manager [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Terminating instance
Aug 01 12:10:01 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-763b8bec-2a74-44e9-ae03-f8e03b46b53d req-a3019b9d-ecee-4426-b340-77877509056d service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-unplugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-763b8bec-2a74-44e9-ae03-f8e03b46b53d req-a3019b9d-ecee-4426-b340-77877509056d service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-763b8bec-2a74-44e9-ae03-f8e03b46b53d req-a3019b9d-ecee-4426-b340-77877509056d service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-763b8bec-2a74-44e9-ae03-f8e03b46b53d req-a3019b9d-ecee-4426-b340-77877509056d service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-763b8bec-2a74-44e9-ae03-f8e03b46b53d req-a3019b9d-ecee-4426-b340-77877509056d service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] No waiting events found dispatching network-vif-unplugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-763b8bec-2a74-44e9-ae03-f8e03b46b53d req-a3019b9d-ecee-4426-b340-77877509056d service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-unplugged-daf90b1b-c7ac-491e-abf6-4f082775e49e for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:02 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Instance destroyed successfully.
Aug 01 12:10:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'resources' on Instance uuid 69cbbc9f-ec82-4a40-9f91-3941db5088e4 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-835329579',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-828231296',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxxZT+XJvl6cXt0RP6eIuO95cu9KfqyvLULPpXEBfcyImvOkOEINjqwZfkv7YYlz1KwfEdDpst8gzxwxzFCtDGY4W8U9WeIv8je0DaEQeVfjpEdkdvkrPrRgDiBrVWtgg==',key_name='tempest-keypair-1393248900',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:08:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-68hqtqu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=69cbbc9f-ec82-4a40-9f91-3941db5088e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "address": "fa:16:3e:3f:e1:31", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaf90b1b-c7", "ovs_interfaceid": "daf90b1b-c7ac-491e-abf6-4f082775e49e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_vif [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaf90b1b-c7, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:10:02 user nova-compute[72178]: INFO os_vif [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:e1:31,bridge_name='br-int',has_traffic_filtering=True,id=daf90b1b-c7ac-491e-abf6-4f082775e49e,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaf90b1b-c7')
Aug 01 12:10:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQZDLiPh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:10:02 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a6799f-0031-404c-a8cc-05d87d4b8128]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f061e6-db16-4df8-a6d0-d77948d4d0e8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:02 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:10:02 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:02 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:10:02 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:02 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:02 user nova-compute[72178]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f (non-flash)
Aug 01 12:10:02 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:02 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:10:02 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:02 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d479dbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f'): ({'sdh'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Removing single pathed devices sdh {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.104s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b9ba65-44fe-44a9-83f9-77082f2a1078]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bb1571-98f8-4166-86e1-5b3b6c6d9e39]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Flushing IO for device /dev/sdh {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.067s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43b4c94-bb27-4090-85fc-fea3b9199b80]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.059s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9df51d-e1a8-4eed-8975-7156c7c4ced0]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] SCSI volumes sdh have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe6b011d2-c6d884166cc97ee3',) {{(pid=83857) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 12:10:02 user nova-compute[72178]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOe6b011d2-c6d884166cc97ee3
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9f3b9-e3d5-49be-9831-0e67b355807e]: (4, None) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad47d289-edee-4db5-9ff3-aee9313643c4]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.250s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c45f4a-eee3-407b-b638-77b4fe6f0797]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260]
Aug 01 12:10:03 user nova-compute[72178]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f, portal: 172.16.0.220,3260] successful.
Aug 01 12:10:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6622ae6-bbb1-420e-a2f7-89085dfb1a6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e868f4-aa0e-42b9-a992-d757b480503d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.685s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] <== disconnect_volume: return (687ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:10:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Deleting instance files /opt/stack/data/nova/instances/69cbbc9f-ec82-4a40-9f91-3941db5088e4_del
Aug 01 12:10:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Deletion of /opt/stack/data/nova/instances/69cbbc9f-ec82-4a40-9f91-3941db5088e4_del complete
Aug 01 12:10:03 user nova-compute[72178]: INFO nova.compute.manager [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Took 1.67 seconds to destroy the instance on the hypervisor.
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG nova.compute.manager [req-d6a99b9d-611e-4f6a-8a91-4f583977d5cf req-13ca5baa-7b2b-4816-a4af-fc09d1884301 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d6a99b9d-611e-4f6a-8a91-4f583977d5cf req-13ca5baa-7b2b-4816-a4af-fc09d1884301 service nova] Acquiring lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d6a99b9d-611e-4f6a-8a91-4f583977d5cf req-13ca5baa-7b2b-4816-a4af-fc09d1884301 service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d6a99b9d-611e-4f6a-8a91-4f583977d5cf req-13ca5baa-7b2b-4816-a4af-fc09d1884301 service nova] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:03 user nova-compute[72178]: DEBUG nova.compute.manager [req-d6a99b9d-611e-4f6a-8a91-4f583977d5cf req-13ca5baa-7b2b-4816-a4af-fc09d1884301 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] No waiting events found dispatching network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:03 user nova-compute[72178]: WARNING nova.compute.manager [req-d6a99b9d-611e-4f6a-8a91-4f583977d5cf req-13ca5baa-7b2b-4816-a4af-fc09d1884301 service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received unexpected event network-vif-plugged-daf90b1b-c7ac-491e-abf6-4f082775e49e for instance with vm_state active and task_state deleting.
Aug 01 12:10:04 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891789.0564337, 0fcffdc5-2321-4287-a89e-d3b7675e19f3 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:04 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] VM Stopped (Lifecycle Event)
Aug 01 12:10:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bd69364a-bb65-4704-9e71-f8a72aed82c5 None None] [instance: 0fcffdc5-2321-4287-a89e-d3b7675e19f3] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:04 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:04 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Took 1.07 seconds to deallocate network for instance.
Aug 01 12:10:05 user nova-compute[72178]: INFO nova.compute.manager [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Took 0.95 seconds to detach 1 volumes for instance.
Aug 01 12:10:05 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Deleting volume: e6622ae6-bbb1-420e-a2f7-89085dfb1a6f {{(pid=72178) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:05 user nova-compute[72178]: INFO nova.compute.manager [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Unshelving
Aug 01 12:10:05 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Refreshing inventories for resource provider f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Updating ProviderTree inventory for provider f106307e-ff81-42a0-bae9-51f40c919103 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Refreshing aggregate associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, aggregates: None {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:05 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Refreshing trait associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-6f86e520-6aca-4d7a-944e-b246d4ff7aa7 req-02891c59-b264-4add-b064-356dc0712dfe service nova] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Received event network-vif-deleted-daf90b1b-c7ac-491e-abf6-4f082775e49e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.951s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.636s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'pci_requests' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'numa_topology' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:10:06 user nova-compute[72178]: INFO nova.compute.claims [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Claim successful on node user
Aug 01 12:10:06 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Deleted allocations for instance 69cbbc9f-ec82-4a40-9f91-3941db5088e4
Aug 01 12:10:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fd7c9c09-0844-435c-b0af-1ad34cd31a99 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "69cbbc9f-ec82-4a40-9f91-3941db5088e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.978s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:10:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:06 user nova-compute[72178]: INFO nova.network.neutron [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updating port e47ac7c6-ea8c-4491-9e2a-2e227b2a305a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 12:10:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquired lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:07 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-169b8942-6464-4a5a-91b0-850b92493964 req-2226cf74-ead8-42d1-b9dd-3d488246a17c service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-changed-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-169b8942-6464-4a5a-91b0-850b92493964 req-2226cf74-ead8-42d1-b9dd-3d488246a17c service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Refreshing instance network info cache due to event network-changed-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-169b8942-6464-4a5a-91b0-850b92493964 req-2226cf74-ead8-42d1-b9dd-3d488246a17c service nova] Acquiring lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updating instance_info_cache with network_info: [{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Releasing lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:10:08 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Creating image(s)
Aug 01 12:10:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-169b8942-6464-4a5a-91b0-850b92493964 req-2226cf74-ead8-42d1-b9dd-3d488246a17c service nova] Acquired lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-169b8942-6464-4a5a-91b0-850b92493964 req-2226cf74-ead8-42d1-b9dd-3d488246a17c service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Refreshing network info cache for port e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "bebb5a3cdf9d388332eb61ce55a00547c1f0b983" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "bebb5a3cdf9d388332eb61ce55a00547c1f0b983" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983.part --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:09 user nova-compute[72178]: DEBUG nova.virt.images [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] 4dd1ca4d-1a00-4e3a-863a-db254fa79995 was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 12:10:09 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:10:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983.part /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG nova.network.neutron [req-169b8942-6464-4a5a-91b0-850b92493964 req-2226cf74-ead8-42d1-b9dd-3d488246a17c service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updated VIF entry in instance network info cache for port e47ac7c6-ea8c-4491-9e2a-2e227b2a305a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG nova.network.neutron [req-169b8942-6464-4a5a-91b0-850b92493964 req-2226cf74-ead8-42d1-b9dd-3d488246a17c service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updating instance_info_cache with network_info: [{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-169b8942-6464-4a5a-91b0-850b92493964 req-2226cf74-ead8-42d1-b9dd-3d488246a17c service nova] Releasing lock "refresh_cache-6341837b-67ea-42df-b3e9-c58e07857774" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983.part /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983.converted" returned: 0 in 0.434s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "bebb5a3cdf9d388332eb61ce55a00547c1f0b983" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.061s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983 --force-share --output=json" returned: 0 in 0.163s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "bebb5a3cdf9d388332eb61ce55a00547c1f0b983" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "bebb5a3cdf9d388332eb61ce55a00547c1f0b983" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983 --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983,backing_fmt=raw /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983,backing_fmt=raw /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk 1073741824" returned: 0 in 0.070s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "bebb5a3cdf9d388332eb61ce55a00547c1f0b983" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983 --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:10 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'migration_context' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Rebasing disk image.
Aug 01 12:10:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 -F raw /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 -F raw /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk" returned: 0 in 2.756s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Ensure instance console log exists: /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Start _get_guest_xml network_info=[{"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='31e52a5cb65900d7ba06aae221044d28',container_format='bare',created_at=2023-08-01T12:08:11Z,direct_url=<?>,disk_format='qcow2',id=4dd1ca4d-1a00-4e3a-863a-db254fa79995,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1643210725-shelved',owner='41cc7b29110b4871a9b5c6e0328bdd28',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T12:08:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:10:13 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:13 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='31e52a5cb65900d7ba06aae221044d28',container_format='bare',created_at=2023-08-01T12:08:11Z,direct_url=<?>,disk_format='qcow2',id=4dd1ca4d-1a00-4e3a-863a-db254fa79995,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1643210725-shelved',owner='41cc7b29110b4871a9b5c6e0328bdd28',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T12:08:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:10:13 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1643210725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1643210725',id=19,image_ref='4dd1ca4d-1a00-4e3a-863a-db254fa79995',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1918189647',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-4l02fltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member',shelved_at='2023-08-01T12:08:16.752640',shelved_host='user',shelved_image_id='4dd1ca4d-1a00-4e3a-863a-db254fa79995'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=6341837b-67ea-42df-b3e9-c58e07857774,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'pci_devices' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:10:14 user nova-compute[72178]:   <uuid>6341837b-67ea-42df-b3e9-c58e07857774</uuid>
Aug 01 12:10:14 user nova-compute[72178]:   <name>instance-00000013</name>
Aug 01 12:10:14 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:10:14 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:10:14 user nova-compute[72178]:   <metadata>
Aug 01 12:10:14 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:10:14 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:10:14 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1643210725</nova:name>
Aug 01 12:10:14 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:10:13</nova:creationTime>
Aug 01 12:10:14 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:10:14 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:10:14 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:10:14 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:10:14 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:10:14 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:10:14 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:10:14 user nova-compute[72178]:       <nova:owner>
Aug 01 12:10:14 user nova-compute[72178]:         <nova:user uuid="435396a1a5f54338a2af729f1e3f1754">tempest-AttachVolumeShelveTestJSON-210279899-project-member</nova:user>
Aug 01 12:10:14 user nova-compute[72178]:         <nova:project uuid="41cc7b29110b4871a9b5c6e0328bdd28">tempest-AttachVolumeShelveTestJSON-210279899</nova:project>
Aug 01 12:10:14 user nova-compute[72178]:       </nova:owner>
Aug 01 12:10:14 user nova-compute[72178]:       <nova:root type="image" uuid="4dd1ca4d-1a00-4e3a-863a-db254fa79995"/>
Aug 01 12:10:14 user nova-compute[72178]:       <nova:ports>
Aug 01 12:10:14 user nova-compute[72178]:         <nova:port uuid="e47ac7c6-ea8c-4491-9e2a-2e227b2a305a">
Aug 01 12:10:14 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 12:10:14 user nova-compute[72178]:         </nova:port>
Aug 01 12:10:14 user nova-compute[72178]:       </nova:ports>
Aug 01 12:10:14 user nova-compute[72178]:     </nova:instance>
Aug 01 12:10:14 user nova-compute[72178]:   </metadata>
Aug 01 12:10:14 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:10:14 user nova-compute[72178]:     <system>
Aug 01 12:10:14 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:10:14 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:10:14 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:10:14 user nova-compute[72178]:       <entry name="serial">6341837b-67ea-42df-b3e9-c58e07857774</entry>
Aug 01 12:10:14 user nova-compute[72178]:       <entry name="uuid">6341837b-67ea-42df-b3e9-c58e07857774</entry>
Aug 01 12:10:14 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:10:14 user nova-compute[72178]:     </system>
Aug 01 12:10:14 user nova-compute[72178]:   </sysinfo>
Aug 01 12:10:14 user nova-compute[72178]:   <os>
Aug 01 12:10:14 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:10:14 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:10:14 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:10:14 user nova-compute[72178]:   </os>
Aug 01 12:10:14 user nova-compute[72178]:   <features>
Aug 01 12:10:14 user nova-compute[72178]:     <acpi/>
Aug 01 12:10:14 user nova-compute[72178]:     <apic/>
Aug 01 12:10:14 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:10:14 user nova-compute[72178]:   </features>
Aug 01 12:10:14 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:10:14 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:10:14 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:10:14 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:10:14 user nova-compute[72178]:   </clock>
Aug 01 12:10:14 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:10:14 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:10:14 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:10:14 user nova-compute[72178]:   </cpu>
Aug 01 12:10:14 user nova-compute[72178]:   <devices>
Aug 01 12:10:14 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:10:14 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:10:14 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk"/>
Aug 01 12:10:14 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:10:14 user nova-compute[72178]:     </disk>
Aug 01 12:10:14 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:10:14 user nova-compute[72178]:       <mac address="fa:16:3e:68:2c:07"/>
Aug 01 12:10:14 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:10:14 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:10:14 user nova-compute[72178]:       <target dev="tape47ac7c6-ea"/>
Aug 01 12:10:14 user nova-compute[72178]:     </interface>
Aug 01 12:10:14 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:10:14 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/console.log" append="off"/>
Aug 01 12:10:14 user nova-compute[72178]:     </serial>
Aug 01 12:10:14 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:10:14 user nova-compute[72178]:     <video>
Aug 01 12:10:14 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:10:14 user nova-compute[72178]:     </video>
Aug 01 12:10:14 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:10:14 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:10:14 user nova-compute[72178]:     </rng>
Aug 01 12:10:14 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:10:14 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:10:14 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:10:14 user nova-compute[72178]:     </memballoon>
Aug 01 12:10:14 user nova-compute[72178]:   </devices>
Aug 01 12:10:14 user nova-compute[72178]: </domain>
Aug 01 12:10:14 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1643210725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1643210725',id=19,image_ref='4dd1ca4d-1a00-4e3a-863a-db254fa79995',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1918189647',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-4l02fltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member',shelved_at='2023-08-01T12:08:16.752640',shelved_host='user',shelved_image_id='4dd1ca4d-1a00-4e3a-863a-db254fa79995'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=6341837b-67ea-42df-b3e9-c58e07857774,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG os_vif [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape47ac7c6-ea, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape47ac7c6-ea, col_values=(('external_ids', {'iface-id': 'e47ac7c6-ea8c-4491-9e2a-2e227b2a305a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:2c:07', 'vm-uuid': '6341837b-67ea-42df-b3e9-c58e07857774'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:14 user nova-compute[72178]: INFO os_vif [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea')
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:10:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] No VIF found with MAC fa:16:3e:68:2c:07, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:10:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-b988395a-4fca-437e-b583-018f1f7f2526 req-b961fe59-8048-402c-a62f-06b6265d75e6 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b988395a-4fca-437e-b583-018f1f7f2526 req-b961fe59-8048-402c-a62f-06b6265d75e6 service nova] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b988395a-4fca-437e-b583-018f1f7f2526 req-b961fe59-8048-402c-a62f-06b6265d75e6 service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b988395a-4fca-437e-b583-018f1f7f2526 req-b961fe59-8048-402c-a62f-06b6265d75e6 service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-b988395a-4fca-437e-b583-018f1f7f2526 req-b961fe59-8048-402c-a62f-06b6265d75e6 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] No waiting events found dispatching network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:16 user nova-compute[72178]: WARNING nova.compute.manager [req-b988395a-4fca-437e-b583-018f1f7f2526 req-b961fe59-8048-402c-a62f-06b6265d75e6 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received unexpected event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 12:10:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:17 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891802.3023007, 69cbbc9f-ec82-4a40-9f91-3941db5088e4 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:17 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] VM Stopped (Lifecycle Event)
Aug 01 12:10:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2658202c-1955-4004-9df0-6c8e54545b4a None None] [instance: 69cbbc9f-ec82-4a40-9f91-3941db5088e4] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:17 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891817.976438, 6341837b-67ea-42df-b3e9-c58e07857774 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] VM Resumed (Lifecycle Event)
Aug 01 12:10:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:10:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:10:17 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance spawned successfully.
Aug 01 12:10:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:10:18 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:10:18 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891817.9768763, 6341837b-67ea-42df-b3e9-c58e07857774 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:18 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] VM Started (Lifecycle Event)
Aug 01 12:10:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:10:18 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:10:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4a59f6b7-8b53-4774-9abd-473c48418f3c tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.862s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-416a53b8-3d3f-44e3-a637-e4efbb93f524 req-20c19489-9501-4952-aecd-c422c9f1f4f8 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-416a53b8-3d3f-44e3-a637-e4efbb93f524 req-20c19489-9501-4952-aecd-c422c9f1f4f8 service nova] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-416a53b8-3d3f-44e3-a637-e4efbb93f524 req-20c19489-9501-4952-aecd-c422c9f1f4f8 service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-416a53b8-3d3f-44e3-a637-e4efbb93f524 req-20c19489-9501-4952-aecd-c422c9f1f4f8 service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-416a53b8-3d3f-44e3-a637-e4efbb93f524 req-20c19489-9501-4952-aecd-c422c9f1f4f8 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] No waiting events found dispatching network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:18 user nova-compute[72178]: WARNING nova.compute.manager [req-416a53b8-3d3f-44e3-a637-e4efbb93f524 req-20c19489-9501-4952-aecd-c422c9f1f4f8 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received unexpected event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a for instance with vm_state active and task_state None.
Aug 01 12:10:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "776b71c1-6696-4575-9c0d-e9340af62167" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:10:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:29 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:10:29 user nova-compute[72178]: INFO nova.compute.claims [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Claim successful on node user
Aug 01 12:10:30 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:10:30 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:10:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:10:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:10:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:10:30 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:10:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:10:30 user nova-compute[72178]: INFO nova.virt.block_device [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Booting with volume-backed-image f38acd7b-c946-4724-9fc4-fe6cae069de4 at /dev/vda
Aug 01 12:10:30 user nova-compute[72178]: DEBUG nova.policy [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec0992e3a27a4a44922268a46b27ad83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5e2fc3212d24561b0b971241fe367ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:10:31 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Successfully created port: e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Successfully updated port: e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquired lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-a55757bc-b36f-4558-921a-6fec01a2fa3f req-23567a62-c19e-4b9d-b55d-9e2eacad1dee service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-changed-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-a55757bc-b36f-4558-921a-6fec01a2fa3f req-23567a62-c19e-4b9d-b55d-9e2eacad1dee service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Refreshing instance network info cache due to event network-changed-e9f19544-b04e-4449-924c-7925cf503a56. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a55757bc-b36f-4558-921a-6fec01a2fa3f req-23567a62-c19e-4b9d-b55d-9e2eacad1dee service nova] Acquiring lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:10:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Updating instance_info_cache with network_info: [{"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Releasing lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance network_info: |[{"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a55757bc-b36f-4558-921a-6fec01a2fa3f req-23567a62-c19e-4b9d-b55d-9e2eacad1dee service nova] Acquired lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-a55757bc-b36f-4558-921a-6fec01a2fa3f req-23567a62-c19e-4b9d-b55d-9e2eacad1dee service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Refreshing network info cache for port e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-a55757bc-b36f-4558-921a-6fec01a2fa3f req-23567a62-c19e-4b9d-b55d-9e2eacad1dee service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Updated VIF entry in instance network info cache for port e9f19544-b04e-4449-924c-7925cf503a56. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-a55757bc-b36f-4558-921a-6fec01a2fa3f req-23567a62-c19e-4b9d-b55d-9e2eacad1dee service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Updating instance_info_cache with network_info: [{"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a55757bc-b36f-4558-921a-6fec01a2fa3f req-23567a62-c19e-4b9d-b55d-9e2eacad1dee service nova] Releasing lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updating instance_info_cache with network_info: [{"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:10:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:10:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:41 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:41 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7031MB free_disk=25.138782501220703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Applying migration context for instance e7e1d3fe-99fe-41fe-bff7-5ea191c529de as it has an incoming, in-progress migration f592cebb-998a-424c-801f-37467ff955a3. Migration status is finished {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 01 12:10:41 user nova-compute[72178]: INFO nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating resource usage from migration f592cebb-998a-424c-801f-37467ff955a3
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f4ae1965-8660-4deb-8427-cafa57f837c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 45795fb0-12dd-4acc-990c-d1192e1ab54b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance c2b7b3b8-1ed3-4754-9699-16839c7394c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Migration f592cebb-998a-424c-801f-37467ff955a3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e7e1d3fe-99fe-41fe-bff7-5ea191c529de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6341837b-67ea-42df-b3e9-c58e07857774 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 776b71c1-6696-4575-9c0d-e9340af62167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG os_brick.utils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e699665b-0c42-4fd6-a410-555f4110897b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2e5242-b5df-4740-9106-7bdd0e2f686c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.092s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ffad8d-96a6-4dfa-8175-9fe54f733d27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c466e891-ee03-4353-aada-0325c64a88aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:10:41 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:10:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fea22ae-b12a-4eb3-9d7d-85d2084d2774]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG os_brick.utils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] <== get_connector_properties: return (247ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:10:41 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Updating existing volume attachment record: cd644bbf-9c5d-49e7-a5e7-796ed0e4cca2 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.830s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:10:42 user nova-compute[72178]: INFO nova.compute.claims [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Claim successful on node user
Aug 01 12:10:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:10:43 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:10:43 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Creating image(s)
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "/opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "/opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "/opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG nova.policy [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7d61300ab4d46fd81eb101da4aac46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090b100be3a14016b833d5b3dff49531', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.185s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk 1073741824" returned: 0 in 0.066s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.193s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Checking if we can resize image /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Cannot resize image /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG nova.objects.instance [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'migration_context' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Ensure instance console log exists: /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-928b701c-cf76-47c1-9d15-f6a0d457276e req-ca3b80a3-5022-49b5-827d-f1cfa9bcc173 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-928b701c-cf76-47c1-9d15-f6a0d457276e req-ca3b80a3-5022-49b5-827d-f1cfa9bcc173 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing instance network info cache due to event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:10:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-928b701c-cf76-47c1-9d15-f6a0d457276e req-ca3b80a3-5022-49b5-827d-f1cfa9bcc173 service nova] Acquiring lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-928b701c-cf76-47c1-9d15-f6a0d457276e req-ca3b80a3-5022-49b5-827d-f1cfa9bcc173 service nova] Acquired lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:45 user nova-compute[72178]: DEBUG nova.network.neutron [req-928b701c-cf76-47c1-9d15-f6a0d457276e req-ca3b80a3-5022-49b5-827d-f1cfa9bcc173 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:10:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Successfully created port: 8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:10:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:46 user nova-compute[72178]: INFO nova.compute.manager [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Shelve offloading
Aug 01 12:10:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:46 user nova-compute[72178]: DEBUG nova.network.neutron [req-928b701c-cf76-47c1-9d15-f6a0d457276e req-ca3b80a3-5022-49b5-827d-f1cfa9bcc173 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updated VIF entry in instance network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:10:46 user nova-compute[72178]: DEBUG nova.network.neutron [req-928b701c-cf76-47c1-9d15-f6a0d457276e req-ca3b80a3-5022-49b5-827d-f1cfa9bcc173 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-928b701c-cf76-47c1-9d15-f6a0d457276e req-ca3b80a3-5022-49b5-827d-f1cfa9bcc173 service nova] Releasing lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:47 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance destroyed successfully.
Aug 01 12:10:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquired lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:47 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:10:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-a13bb0f6-8330-489d-a34c-98003898b1eb req-2e910dfa-8607-484e-906d-6d806da1f4c0 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-unplugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a13bb0f6-8330-489d-a34c-98003898b1eb req-2e910dfa-8607-484e-906d-6d806da1f4c0 service nova] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a13bb0f6-8330-489d-a34c-98003898b1eb req-2e910dfa-8607-484e-906d-6d806da1f4c0 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a13bb0f6-8330-489d-a34c-98003898b1eb req-2e910dfa-8607-484e-906d-6d806da1f4c0 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-a13bb0f6-8330-489d-a34c-98003898b1eb req-2e910dfa-8607-484e-906d-6d806da1f4c0 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] No waiting events found dispatching network-vif-unplugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:48 user nova-compute[72178]: WARNING nova.compute.manager [req-a13bb0f6-8330-489d-a34c-98003898b1eb req-2e910dfa-8607-484e-906d-6d806da1f4c0 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received unexpected event network-vif-unplugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a for instance with vm_state active and task_state shelving.
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Successfully updated port: 8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquired lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:10:48 user nova-compute[72178]: INFO nova.compute.claims [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Claim successful on node user
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:10:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:10:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:10:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Creating image(s)
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "/opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "/opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "/opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Releasing lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.policy [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd81d3a10a4819a414d5a61a9d6056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874d88ce21b743e195c696aaa7195ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk 1073741824" returned: 0 in 0.060s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating instance_info_cache with network_info: [{"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Releasing lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Instance network_info: |[{"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Start _get_guest_xml network_info=[{"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:10:49 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:49 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-571208767',display_name='tempest-SnapshotDataIntegrityTests-server-571208767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-571208767',id=29,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7+PjH7LyGgcx0Uts+/yvjjSKORVxZyd3kbqmtlqMexU2XC+uZhKAPeswgoZYA96ss4RXiwm76fkLQCZcAEfNgOoPmRZPNuy4s/wFKEnWzrGXtJYSBWN7mOXWFMMS8xtA==',key_name='tempest-keypair-1164477765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090b100be3a14016b833d5b3dff49531',ramdisk_id='',reservation_id='r-0nblgvgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2016174200',owner_user_name='tempest-SnapshotDataIntegrityTests-2016174200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7d61300ab4d46fd81eb101da4aac46d',uuid=febae49f-2d0b-4f28-a695-0ecaaf120077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Converting VIF {"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=8ed79e30-ec8c-4ab4-9447-738d5d07cdbc,network=Network(67aad9d3-8a4f-445a-a940-7cbe49c23662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ed79e30-ec') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.objects.instance [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'pci_devices' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.179s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:10:49 user nova-compute[72178]:   <uuid>febae49f-2d0b-4f28-a695-0ecaaf120077</uuid>
Aug 01 12:10:49 user nova-compute[72178]:   <name>instance-0000001d</name>
Aug 01 12:10:49 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:10:49 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:10:49 user nova-compute[72178]:   <metadata>
Aug 01 12:10:49 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:10:49 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:10:49 user nova-compute[72178]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-571208767</nova:name>
Aug 01 12:10:49 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:10:49</nova:creationTime>
Aug 01 12:10:49 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:10:49 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:10:49 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:10:49 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:10:49 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:10:49 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:10:49 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:10:49 user nova-compute[72178]:       <nova:owner>
Aug 01 12:10:49 user nova-compute[72178]:         <nova:user uuid="f7d61300ab4d46fd81eb101da4aac46d">tempest-SnapshotDataIntegrityTests-2016174200-project-member</nova:user>
Aug 01 12:10:49 user nova-compute[72178]:         <nova:project uuid="090b100be3a14016b833d5b3dff49531">tempest-SnapshotDataIntegrityTests-2016174200</nova:project>
Aug 01 12:10:49 user nova-compute[72178]:       </nova:owner>
Aug 01 12:10:49 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:10:49 user nova-compute[72178]:       <nova:ports>
Aug 01 12:10:49 user nova-compute[72178]:         <nova:port uuid="8ed79e30-ec8c-4ab4-9447-738d5d07cdbc">
Aug 01 12:10:49 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 12:10:49 user nova-compute[72178]:         </nova:port>
Aug 01 12:10:49 user nova-compute[72178]:       </nova:ports>
Aug 01 12:10:49 user nova-compute[72178]:     </nova:instance>
Aug 01 12:10:49 user nova-compute[72178]:   </metadata>
Aug 01 12:10:49 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:10:49 user nova-compute[72178]:     <system>
Aug 01 12:10:49 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:10:49 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:10:49 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:10:49 user nova-compute[72178]:       <entry name="serial">febae49f-2d0b-4f28-a695-0ecaaf120077</entry>
Aug 01 12:10:49 user nova-compute[72178]:       <entry name="uuid">febae49f-2d0b-4f28-a695-0ecaaf120077</entry>
Aug 01 12:10:49 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:10:49 user nova-compute[72178]:     </system>
Aug 01 12:10:49 user nova-compute[72178]:   </sysinfo>
Aug 01 12:10:49 user nova-compute[72178]:   <os>
Aug 01 12:10:49 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:10:49 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:10:49 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:10:49 user nova-compute[72178]:   </os>
Aug 01 12:10:49 user nova-compute[72178]:   <features>
Aug 01 12:10:49 user nova-compute[72178]:     <acpi/>
Aug 01 12:10:49 user nova-compute[72178]:     <apic/>
Aug 01 12:10:49 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:10:49 user nova-compute[72178]:   </features>
Aug 01 12:10:49 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:10:49 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:10:49 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:10:49 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:10:49 user nova-compute[72178]:   </clock>
Aug 01 12:10:49 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:10:49 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:10:49 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:10:49 user nova-compute[72178]:   </cpu>
Aug 01 12:10:49 user nova-compute[72178]:   <devices>
Aug 01 12:10:49 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:10:49 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:10:49 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk"/>
Aug 01 12:10:49 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:10:49 user nova-compute[72178]:     </disk>
Aug 01 12:10:49 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:10:49 user nova-compute[72178]:       <mac address="fa:16:3e:d2:93:c8"/>
Aug 01 12:10:49 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:10:49 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:10:49 user nova-compute[72178]:       <target dev="tap8ed79e30-ec"/>
Aug 01 12:10:49 user nova-compute[72178]:     </interface>
Aug 01 12:10:49 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:10:49 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/console.log" append="off"/>
Aug 01 12:10:49 user nova-compute[72178]:     </serial>
Aug 01 12:10:49 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:10:49 user nova-compute[72178]:     <video>
Aug 01 12:10:49 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:10:49 user nova-compute[72178]:     </video>
Aug 01 12:10:49 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:10:49 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:10:49 user nova-compute[72178]:     </rng>
Aug 01 12:10:49 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:10:49 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:10:49 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:10:49 user nova-compute[72178]:     </memballoon>
Aug 01 12:10:49 user nova-compute[72178]:   </devices>
Aug 01 12:10:49 user nova-compute[72178]: </domain>
Aug 01 12:10:49 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-571208767',display_name='tempest-SnapshotDataIntegrityTests-server-571208767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-571208767',id=29,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7+PjH7LyGgcx0Uts+/yvjjSKORVxZyd3kbqmtlqMexU2XC+uZhKAPeswgoZYA96ss4RXiwm76fkLQCZcAEfNgOoPmRZPNuy4s/wFKEnWzrGXtJYSBWN7mOXWFMMS8xtA==',key_name='tempest-keypair-1164477765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090b100be3a14016b833d5b3dff49531',ramdisk_id='',reservation_id='r-0nblgvgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2016174200',owner_user_name='tempest-SnapshotDataIntegrityTests-2016174200-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7d61300ab4d46fd81eb101da4aac46d',uuid=febae49f-2d0b-4f28-a695-0ecaaf120077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Converting VIF {"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=8ed79e30-ec8c-4ab4-9447-738d5d07cdbc,network=Network(67aad9d3-8a4f-445a-a940-7cbe49c23662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ed79e30-ec') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG os_vif [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=8ed79e30-ec8c-4ab4-9447-738d5d07cdbc,network=Network(67aad9d3-8a4f-445a-a940-7cbe49c23662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ed79e30-ec') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ed79e30-ec, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ed79e30-ec, col_values=(('external_ids', {'iface-id': '8ed79e30-ec8c-4ab4-9447-738d5d07cdbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:93:c8', 'vm-uuid': 'febae49f-2d0b-4f28-a695-0ecaaf120077'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:10:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:49 user nova-compute[72178]: INFO os_vif [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=8ed79e30-ec8c-4ab4-9447-738d5d07cdbc,network=Network(67aad9d3-8a4f-445a-a940-7cbe49c23662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ed79e30-ec')
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Cannot resize image /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.objects.instance [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'migration_context' on Instance uuid be40c1ae-0b3e-43c6-804b-ce8158b49233 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No VIF found with MAC fa:16:3e:d2:93:c8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Ensure instance console log exists: /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] No waiting events found dispatching network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:50 user nova-compute[72178]: WARNING nova.compute.manager [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received unexpected event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a for instance with vm_state active and task_state shelving.
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received event network-changed-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Refreshing instance network info cache due to event network-changed-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Acquiring lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Acquired lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Refreshing network info cache for port 8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:10:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:10:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Creating image(s)
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Ensure instance console log exists: /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Start _get_guest_xml network_info=[{"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HClEGrQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '776b71c1-6696-4575-9c0d-e9340af62167', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2e04741-b105-4a08-a399-d496e798a21f', 'serial': 'e2e04741-b105-4a08-a399-d496e798a21f'}, 'boot_index': 0, 'attachment_id': 'cd644bbf-9c5d-49e7-a5e7-796ed0e4cca2', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:10:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance destroyed successfully.
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lazy-loading 'resources' on Instance uuid c2b7b3b8-1ed3-4754-9699-16839c7394c7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:51 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:51 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1328072652',display_name='tempest-TestShelveInstance-server-1328072652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1328072652',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwjwe2NdthKjiiiDi8LPsHxZ0tDKDs/9Uun1Ww17FDngKtnc7NvmGm3AznOcjSbg9LqkomceEK+3+pVvsZSqMdN7zaprPelRi8gxSWDIdFhuk2cLYa22E7aX89S4/oyPg==',key_name='tempest-TestShelveInstance-619818221',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:09:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729b625630fd4a26ba76891d65a5f5bc',ramdisk_id='',reservation_id='r-2737bifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-297202234',owner_user_name='tempest-TestShelveInstance-297202234-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:09:09Z,user_data=None,user_id='192962f272724516b92bb7c10add101b',uuid=c2b7b3b8-1ed3-4754-9699-16839c7394c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converting VIF {"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_vif [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.network.neutron [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Successfully created port: 55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee85ca88-4f, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HClEGrQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:10:51 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:10:51 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:10:51 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:10:51 user nova-compute[72178]: INFO os_vif [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f')
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUfTGMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:10:51 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9cc786-a979-4bdf-a652-60bdf0b4a660]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:10:51 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.network.neutron [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updated VIF entry in instance network info cache for port 8ed79e30-ec8c-4ab4-9447-738d5d07cdbc. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.network.neutron [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating instance_info_cache with network_info: [{"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Releasing lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing instance network info cache due to event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Acquiring lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Acquired lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.network.neutron [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.090s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f7b7b4-ae2e-46be-b5cd-918cd285d640]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f] added
Aug 01 12:10:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce539a9f-07b0-46ed-846a-d045c54327fc]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eb3f00-7a78-45c3-8234-df117ca9fe00]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HClEGrQu {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HClEGrQu" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8559748a-2dc7-4ca8-b258-9e334e80b63e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HClEGrQu'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc79f76-398d-4158-b6d2-52fed6f8a82e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1578d0-d376-4ad6-a068-11721f5fda7a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-aaf3458a-4aa5-4be0-96d2-bcb56f1bd080 req-bf85a59a-ae28-487d-badd-58786a8d1cf9 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-aaf3458a-4aa5-4be0-96d2-bcb56f1bd080 req-bf85a59a-ae28-487d-badd-58786a8d1cf9 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing instance network info cache due to event network-changed-b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aaf3458a-4aa5-4be0-96d2-bcb56f1bd080 req-bf85a59a-ae28-487d-badd-58786a8d1cf9 service nova] Acquiring lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a850df-a9c9-4655-8d4d-403a2b59652c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f, portal: 172.16.0.220,3260]
Aug 01 12:10:51 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f, portal: 172.16.0.220,3260] successful.
Aug 01 12:10:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff28f56-fcad-435a-a89a-531a3f74f3d1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d712df-5e7a-4345-aa53-f983102b6c4b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:10:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:51 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:10:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6252f28-2ff7-45c8-9999-e5217118f9e3]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HClEGrQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:51 user nova-compute[72178]: INFO nova.compute.manager [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Detaching volume 5367c6fe-b654-415f-ac02-36610a5ba891
Aug 01 12:10:51 user nova-compute[72178]: INFO nova.virt.block_device [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Attempting to driver detach volume 5367c6fe-b654-415f-ac02-36610a5ba891 from mountpoint /dev/vdb
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Attempting to detach device vdb from instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:10:51 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:10:51 user nova-compute[72178]:   <source dev="/dev/sdi"/>
Aug 01 12:10:51 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:10:51 user nova-compute[72178]:   <serial>5367c6fe-b654-415f-ac02-36610a5ba891</serial>
Aug 01 12:10:51 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 12:10:51 user nova-compute[72178]: </disk>
Aug 01 12:10:51 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:10:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully detached device vdb from instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb from the persistent domain config.
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:10:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:10:51 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:10:51 user nova-compute[72178]:   <source dev="/dev/sdi"/>
Aug 01 12:10:51 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:10:51 user nova-compute[72178]:   <serial>5367c6fe-b654-415f-ac02-36610a5ba891</serial>
Aug 01 12:10:51 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 12:10:51 user nova-compute[72178]: </disk>
Aug 01 12:10:51 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-169790b2-89de-4d6c-a3ab-e8dfb94cf995 req-5ec9ae99-d382-4d91-b05e-513b7097f791 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received event network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-169790b2-89de-4d6c-a3ab-e8dfb94cf995 req-5ec9ae99-d382-4d91-b05e-513b7097f791 service nova] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-169790b2-89de-4d6c-a3ab-e8dfb94cf995 req-5ec9ae99-d382-4d91-b05e-513b7097f791 service nova] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-169790b2-89de-4d6c-a3ab-e8dfb94cf995 req-5ec9ae99-d382-4d91-b05e-513b7097f791 service nova] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-169790b2-89de-4d6c-a3ab-e8dfb94cf995 req-5ec9ae99-d382-4d91-b05e-513b7097f791 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] No waiting events found dispatching network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:52 user nova-compute[72178]: WARNING nova.compute.manager [req-169790b2-89de-4d6c-a3ab-e8dfb94cf995 req-5ec9ae99-d382-4d91-b05e-513b7097f791 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received unexpected event network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc for instance with vm_state building and task_state spawning.
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-0d1d4b1f-25da-4581-81d3-fb00a1b1c347 req-708d689e-0b09-486a-8846-7f48b36797ab service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-0d1d4b1f-25da-4581-81d3-fb00a1b1c347 req-708d689e-0b09-486a-8846-7f48b36797ab service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing instance network info cache due to event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0d1d4b1f-25da-4581-81d3-fb00a1b1c347 req-708d689e-0b09-486a-8846-7f48b36797ab service nova] Acquiring lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0d1d4b1f-25da-4581-81d3-fb00a1b1c347 req-708d689e-0b09-486a-8846-7f48b36797ab service nova] Acquired lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.network.neutron [req-0d1d4b1f-25da-4581-81d3-fb00a1b1c347 req-708d689e-0b09-486a-8846-7f48b36797ab service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.network.neutron [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updated VIF entry in instance network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.network.neutron [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating instance_info_cache with network_info: [{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-31d6c254-bc31-4eb1-9450-f9f91cecd008 req-c0aa2e55-f9bb-46b7-b2a2-397d2f7b0bc3 service nova] Releasing lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aaf3458a-4aa5-4be0-96d2-bcb56f1bd080 req-bf85a59a-ae28-487d-badd-58786a8d1cf9 service nova] Acquired lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.network.neutron [req-aaf3458a-4aa5-4be0-96d2-bcb56f1bd080 req-bf85a59a-ae28-487d-badd-58786a8d1cf9 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Refreshing network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891852.4804587, d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:10:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully detached device vdb from instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb from the live domain config.
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drvNFkOt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:10:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '26238656535383638', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238656535383638', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.497s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c7b6fa-7e42-4605-8b2b-80dd2831ae76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-136494262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-136494262',id=28,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-ddvy2rh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:30Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=776b71c1-6696-4575-9c0d-e9340af62167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=e9f19544-b04e-4449-924c-7925cf503a56,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f19544-b0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'pci_devices' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:10:52 user nova-compute[72178]:   <uuid>776b71c1-6696-4575-9c0d-e9340af62167</uuid>
Aug 01 12:10:52 user nova-compute[72178]:   <name>instance-0000001c</name>
Aug 01 12:10:52 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:10:52 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:10:52 user nova-compute[72178]:   <metadata>
Aug 01 12:10:52 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:10:52 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:10:52 user nova-compute[72178]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-136494262</nova:name>
Aug 01 12:10:52 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:10:51</nova:creationTime>
Aug 01 12:10:52 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:10:52 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:10:52 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:10:52 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:10:52 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:10:52 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:10:52 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:10:52 user nova-compute[72178]:       <nova:owner>
Aug 01 12:10:52 user nova-compute[72178]:         <nova:user uuid="ec0992e3a27a4a44922268a46b27ad83">tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member</nova:user>
Aug 01 12:10:52 user nova-compute[72178]:         <nova:project uuid="d5e2fc3212d24561b0b971241fe367ec">tempest-ServerBootFromVolumeStableRescueTest-2013636577</nova:project>
Aug 01 12:10:52 user nova-compute[72178]:       </nova:owner>
Aug 01 12:10:52 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:10:52 user nova-compute[72178]:       <nova:ports>
Aug 01 12:10:52 user nova-compute[72178]:         <nova:port uuid="e9f19544-b04e-4449-924c-7925cf503a56">
Aug 01 12:10:52 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 12:10:52 user nova-compute[72178]:         </nova:port>
Aug 01 12:10:52 user nova-compute[72178]:       </nova:ports>
Aug 01 12:10:52 user nova-compute[72178]:     </nova:instance>
Aug 01 12:10:52 user nova-compute[72178]:   </metadata>
Aug 01 12:10:52 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:10:52 user nova-compute[72178]:     <system>
Aug 01 12:10:52 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:10:52 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:10:52 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:10:52 user nova-compute[72178]:       <entry name="serial">776b71c1-6696-4575-9c0d-e9340af62167</entry>
Aug 01 12:10:52 user nova-compute[72178]:       <entry name="uuid">776b71c1-6696-4575-9c0d-e9340af62167</entry>
Aug 01 12:10:52 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:10:52 user nova-compute[72178]:     </system>
Aug 01 12:10:52 user nova-compute[72178]:   </sysinfo>
Aug 01 12:10:52 user nova-compute[72178]:   <os>
Aug 01 12:10:52 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:10:52 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:10:52 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:10:52 user nova-compute[72178]:   </os>
Aug 01 12:10:52 user nova-compute[72178]:   <features>
Aug 01 12:10:52 user nova-compute[72178]:     <acpi/>
Aug 01 12:10:52 user nova-compute[72178]:     <apic/>
Aug 01 12:10:52 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:10:52 user nova-compute[72178]:   </features>
Aug 01 12:10:52 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:10:52 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:10:52 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:10:52 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:10:52 user nova-compute[72178]:   </clock>
Aug 01 12:10:52 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:10:52 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:10:52 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:10:52 user nova-compute[72178]:   </cpu>
Aug 01 12:10:52 user nova-compute[72178]:   <devices>
Aug 01 12:10:52 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:10:52 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:10:52 user nova-compute[72178]:       <source dev="/dev/sdd"/>
Aug 01 12:10:52 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:10:52 user nova-compute[72178]:       <serial>e2e04741-b105-4a08-a399-d496e798a21f</serial>
Aug 01 12:10:52 user nova-compute[72178]:     </disk>
Aug 01 12:10:52 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:10:52 user nova-compute[72178]:       <mac address="fa:16:3e:d6:6b:b7"/>
Aug 01 12:10:52 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:10:52 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:10:52 user nova-compute[72178]:       <target dev="tape9f19544-b0"/>
Aug 01 12:10:52 user nova-compute[72178]:     </interface>
Aug 01 12:10:52 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:10:52 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/console.log" append="off"/>
Aug 01 12:10:52 user nova-compute[72178]:     </serial>
Aug 01 12:10:52 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:10:52 user nova-compute[72178]:     <video>
Aug 01 12:10:52 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:10:52 user nova-compute[72178]:     </video>
Aug 01 12:10:52 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:10:52 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:10:52 user nova-compute[72178]:     </rng>
Aug 01 12:10:52 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:10:52 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:10:52 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:10:52 user nova-compute[72178]:     </memballoon>
Aug 01 12:10:52 user nova-compute[72178]:   </devices>
Aug 01 12:10:52 user nova-compute[72178]: </domain>
Aug 01 12:10:52 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-136494262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-136494262',id=28,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-ddvy2rh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:30Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=776b71c1-6696-4575-9c0d-e9340af62167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=e9f19544-b04e-4449-924c-7925cf503a56,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f19544-b0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_vif [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=e9f19544-b04e-4449-924c-7925cf503a56,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f19544-b0') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9f19544-b0, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9f19544-b0, col_values=(('external_ids', {'iface-id': 'e9f19544-b04e-4449-924c-7925cf503a56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:6b:b7', 'vm-uuid': '776b71c1-6696-4575-9c0d-e9340af62167'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ea2519-95fc-468f-af0e-7a82a6c2b3b5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:52 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:52 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:10:52 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:52 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:10:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:52 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:52 user nova-compute[72178]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:10:52 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:52 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:10:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f412d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0'): ({'sdj'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Removing single pathed devices sdj {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:52 user nova-compute[72178]: INFO os_vif [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=e9f19544-b04e-4449-924c-7925cf503a56,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f19544-b0')
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9d483d-9feb-4515-9778-0d3ab809c4d2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[020d8948-aad3-4f01-9dd7-5dc7cdceb971]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Flushing IO for device /dev/sdj {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf7707c-05ac-4e5e-be60-c27b9b8aeea9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No VIF found with MAC fa:16:3e:d6:6b:b7, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.055s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[33efaa2c-1a4b-46d9-ab94-aed1e48096b1]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] SCSI volumes sdj have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[09424ae6-a55e-4c60-94e7-9ef4419417f1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.149s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f78b7b-c10e-42ee-9666-36e4470b3150]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260]
Aug 01 12:10:53 user nova-compute[72178]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260] successful.
Aug 01 12:10:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e7db1c-f52a-42fc-8a25-7aee51ec3731]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] <== disconnect_volume: return (1982ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:10:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Deleting instance files /opt/stack/data/nova/instances/c2b7b3b8-1ed3-4754-9699-16839c7394c7_del
Aug 01 12:10:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Deletion of /opt/stack/data/nova/instances/c2b7b3b8-1ed3-4754-9699-16839c7394c7_del complete
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.606s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1371b8-91c8-4acd-a654-51e91613c2ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcacaa2d-aaf7-4063-8602-717f1dd50c17]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:53 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:53 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:53 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:10:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:10:53 user nova-compute[72178]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 (non-flash)
Aug 01 12:10:53 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:10:53 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:10:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f412e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891'): ({'sdi'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Removing single pathed devices sdi {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb507d-098f-430b-ad56-e78db169745c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[84612518-13b9-4bb9-8f01-9923647f8288]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flushing IO for device /dev/sdi {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c239e201-b432-41bc-afb1-3bdff4a0d942]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b17c1cf-59cf-4f3e-befe-8b445f653b08]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] SCSI volumes sdi have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d67c42-eb72-4529-9c48-ba0632513ddf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "f4ae1965-8660-4deb-8427-cafa57f837c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b5fdea-f7c0-48c1-96cd-6273370f7dce]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260]
Aug 01 12:10:53 user nova-compute[72178]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891, portal: 172.16.0.220,3260] successful.
Aug 01 12:10:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:53 user nova-compute[72178]: INFO nova.compute.manager [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Terminating instance
Aug 01 12:10:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5367c6fe-b654-415f-ac02-36610a5ba891 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7048506-0f98-4df0-ae13-175722fa6113]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] <== disconnect_volume: return (968ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Successfully updated port: 55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-0d1d4b1f-25da-4581-81d3-fb00a1b1c347 req-708d689e-0b09-486a-8846-7f48b36797ab service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updated VIF entry in instance network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-0d1d4b1f-25da-4581-81d3-fb00a1b1c347 req-708d689e-0b09-486a-8846-7f48b36797ab service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": null, "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapee85ca88-4f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-aaf3458a-4aa5-4be0-96d2-bcb56f1bd080 req-bf85a59a-ae28-487d-badd-58786a8d1cf9 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updated VIF entry in instance network info cache for port b6e7f28c-7e67-4026-9f1b-ca5884180e74. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-aaf3458a-4aa5-4be0-96d2-bcb56f1bd080 req-bf85a59a-ae28-487d-badd-58786a8d1cf9 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating instance_info_cache with network_info: [{"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquired lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0d1d4b1f-25da-4581-81d3-fb00a1b1c347 req-708d689e-0b09-486a-8846-7f48b36797ab service nova] Releasing lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aaf3458a-4aa5-4be0-96d2-bcb56f1bd080 req-bf85a59a-ae28-487d-badd-58786a8d1cf9 service nova] Releasing lock "refresh_cache-d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-0aae9d8b-9dc4-476d-afaf-1dbf84a9fd78 req-82bd1e2a-deaa-4832-b544-a088abb8b8e9 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received event network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0aae9d8b-9dc4-476d-afaf-1dbf84a9fd78 req-82bd1e2a-deaa-4832-b544-a088abb8b8e9 service nova] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0aae9d8b-9dc4-476d-afaf-1dbf84a9fd78 req-82bd1e2a-deaa-4832-b544-a088abb8b8e9 service nova] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0aae9d8b-9dc4-476d-afaf-1dbf84a9fd78 req-82bd1e2a-deaa-4832-b544-a088abb8b8e9 service nova] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-0aae9d8b-9dc4-476d-afaf-1dbf84a9fd78 req-82bd1e2a-deaa-4832-b544-a088abb8b8e9 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] No waiting events found dispatching network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:54 user nova-compute[72178]: WARNING nova.compute.manager [req-0aae9d8b-9dc4-476d-afaf-1dbf84a9fd78 req-82bd1e2a-deaa-4832-b544-a088abb8b8e9 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received unexpected event network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc for instance with vm_state building and task_state spawning.
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received event network-changed-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Refreshing instance network info cache due to event network-changed-55817a06-eb38-4811-a4d8-41aeab256257. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] Acquiring lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891854.527968, febae49f-2d0b-4f28-a695-0ecaaf120077 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] VM Resumed (Lifecycle Event)
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Instance spawned successfully.
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891854.5372474, febae49f-2d0b-4f28-a695-0ecaaf120077 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] VM Started (Lifecycle Event)
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Updating instance_info_cache with network_info: [{"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Deleted allocations for instance c2b7b3b8-1ed3-4754-9699-16839c7394c7
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Releasing lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Instance network_info: |[{"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] Acquired lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Refreshing network info cache for port 55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Start _get_guest_xml network_info=[{"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'flavor' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:54 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:54 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-161172345',display_name='tempest-AttachVolumeNegativeTest-server-161172345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-161172345',id=30,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkOdEjD9EProSDLF6B6vhbLzqSDohdLQyReWO+9u9hBvamQLgDk0bd6znywNQxH1Iu19mxSQSAnvmA5838qGQek1uaR4c1Nzcbc9xz28JRD5kmEH/UgM5guPUt0/KYBQ==',key_name='tempest-keypair-1087726270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-mibxukjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=be40c1ae-0b3e-43c6-804b-ce8158b49233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=55817a06-eb38-4811-a4d8-41aeab256257,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55817a06-eb') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'pci_devices' on Instance uuid be40c1ae-0b3e-43c6-804b-ce8158b49233 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Instance destroyed successfully.
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lazy-loading 'numa_topology' on Instance uuid c2b7b3b8-1ed3-4754-9699-16839c7394c7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-29e191d6-5eea-4da0-98cf-e91488bd2ebf tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.078s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lazy-loading 'resources' on Instance uuid f4ae1965-8660-4deb-8427-cafa57f837c8 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Took 11.23 seconds to spawn the instance on the hypervisor.
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:10:54 user nova-compute[72178]:   <uuid>be40c1ae-0b3e-43c6-804b-ce8158b49233</uuid>
Aug 01 12:10:54 user nova-compute[72178]:   <name>instance-0000001e</name>
Aug 01 12:10:54 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:10:54 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:10:54 user nova-compute[72178]:   <metadata>
Aug 01 12:10:54 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:10:54 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:10:54 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeNegativeTest-server-161172345</nova:name>
Aug 01 12:10:54 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:10:54</nova:creationTime>
Aug 01 12:10:54 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:10:54 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:10:54 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:10:54 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:10:54 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:10:54 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:10:54 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:10:54 user nova-compute[72178]:       <nova:owner>
Aug 01 12:10:54 user nova-compute[72178]:         <nova:user uuid="73fd81d3a10a4819a414d5a61a9d6056">tempest-AttachVolumeNegativeTest-1677263646-project-member</nova:user>
Aug 01 12:10:54 user nova-compute[72178]:         <nova:project uuid="874d88ce21b743e195c696aaa7195ffc">tempest-AttachVolumeNegativeTest-1677263646</nova:project>
Aug 01 12:10:54 user nova-compute[72178]:       </nova:owner>
Aug 01 12:10:54 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:10:54 user nova-compute[72178]:       <nova:ports>
Aug 01 12:10:54 user nova-compute[72178]:         <nova:port uuid="55817a06-eb38-4811-a4d8-41aeab256257">
Aug 01 12:10:54 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 12:10:54 user nova-compute[72178]:         </nova:port>
Aug 01 12:10:54 user nova-compute[72178]:       </nova:ports>
Aug 01 12:10:54 user nova-compute[72178]:     </nova:instance>
Aug 01 12:10:54 user nova-compute[72178]:   </metadata>
Aug 01 12:10:54 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:10:54 user nova-compute[72178]:     <system>
Aug 01 12:10:54 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:10:54 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:10:54 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:10:54 user nova-compute[72178]:       <entry name="serial">be40c1ae-0b3e-43c6-804b-ce8158b49233</entry>
Aug 01 12:10:54 user nova-compute[72178]:       <entry name="uuid">be40c1ae-0b3e-43c6-804b-ce8158b49233</entry>
Aug 01 12:10:54 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:10:54 user nova-compute[72178]:     </system>
Aug 01 12:10:54 user nova-compute[72178]:   </sysinfo>
Aug 01 12:10:54 user nova-compute[72178]:   <os>
Aug 01 12:10:54 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:10:54 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:10:54 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:10:54 user nova-compute[72178]:   </os>
Aug 01 12:10:54 user nova-compute[72178]:   <features>
Aug 01 12:10:54 user nova-compute[72178]:     <acpi/>
Aug 01 12:10:54 user nova-compute[72178]:     <apic/>
Aug 01 12:10:54 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:10:54 user nova-compute[72178]:   </features>
Aug 01 12:10:54 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:10:54 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:10:54 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:10:54 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:10:54 user nova-compute[72178]:   </clock>
Aug 01 12:10:54 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:10:54 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:10:54 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:10:54 user nova-compute[72178]:   </cpu>
Aug 01 12:10:54 user nova-compute[72178]:   <devices>
Aug 01 12:10:54 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:10:54 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:10:54 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk"/>
Aug 01 12:10:54 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:10:54 user nova-compute[72178]:     </disk>
Aug 01 12:10:54 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:10:54 user nova-compute[72178]:       <mac address="fa:16:3e:6b:33:8a"/>
Aug 01 12:10:54 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:10:54 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:10:54 user nova-compute[72178]:       <target dev="tap55817a06-eb"/>
Aug 01 12:10:54 user nova-compute[72178]:     </interface>
Aug 01 12:10:54 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:10:54 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/console.log" append="off"/>
Aug 01 12:10:54 user nova-compute[72178]:     </serial>
Aug 01 12:10:54 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:10:54 user nova-compute[72178]:     <video>
Aug 01 12:10:54 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:10:54 user nova-compute[72178]:     </video>
Aug 01 12:10:54 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:10:54 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:10:54 user nova-compute[72178]:     </rng>
Aug 01 12:10:54 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:10:54 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:10:54 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:10:54 user nova-compute[72178]:     </memballoon>
Aug 01 12:10:54 user nova-compute[72178]:   </devices>
Aug 01 12:10:54 user nova-compute[72178]: </domain>
Aug 01 12:10:54 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-161172345',display_name='tempest-AttachVolumeNegativeTest-server-161172345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-161172345',id=30,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkOdEjD9EProSDLF6B6vhbLzqSDohdLQyReWO+9u9hBvamQLgDk0bd6znywNQxH1Iu19mxSQSAnvmA5838qGQek1uaR4c1Nzcbc9xz28JRD5kmEH/UgM5guPUt0/KYBQ==',key_name='tempest-keypair-1087726270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-mibxukjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=be40c1ae-0b3e-43c6-804b-ce8158b49233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=55817a06-eb38-4811-a4d8-41aeab256257,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55817a06-eb') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG os_vif [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=55817a06-eb38-4811-a4d8-41aeab256257,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55817a06-eb') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:04:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1406287704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1406287704',id=18,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwKpu63TDZ2dE90KUlxR6gihMelJM8kyz6h2HQUyVAVSvHZvdFZHoiDJUpUEHmUelPFwD4bL3nr9jBqwV5AZ97OV8UBY7k3Pb0wb46vrcxs9nDXNVTW0EOXuHMZbuATew==',key_name='tempest-keypair-181046735',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:04:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7ee13aa6423e4d33bfe59e2a092a5578',ramdisk_id='',reservation_id='r-w0o1rt6x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1322074',owner_user_name='tempest-ServerActionsV293TestJSON-1322074-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:04:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='551db946d0e94b50af2c5c659f4c82ce',uuid=f4ae1965-8660-4deb-8427-cafa57f837c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converting VIF {"id": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "address": "fa:16:3e:15:fc:55", "network": {"id": "20c50e68-98ae-4b44-8e74-e899d562cb75", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-16868067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7ee13aa6423e4d33bfe59e2a092a5578", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1a144e-d9", "ovs_interfaceid": "ce1a144e-d9df-4bb3-846d-7e0ebffd4373", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=ce1a144e-d9df-4bb3-846d-7e0ebffd4373,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a144e-d9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG os_vif [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=ce1a144e-d9df-4bb3-846d-7e0ebffd4373,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a144e-d9') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce1a144e-d9, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55817a06-eb, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55817a06-eb, col_values=(('external_ids', {'iface-id': '55817a06-eb38-4811-a4d8-41aeab256257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:33:8a', 'vm-uuid': 'be40c1ae-0b3e-43c6-804b-ce8158b49233'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:10:54 user nova-compute[72178]: INFO os_vif [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:55,bridge_name='br-int',has_traffic_filtering=True,id=ce1a144e-d9df-4bb3-846d-7e0ebffd4373,network=Network(20c50e68-98ae-4b44-8e74-e899d562cb75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1a144e-d9')
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Deleting instance files /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8_del
Aug 01 12:10:54 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Deletion of /opt/stack/data/nova/instances/f4ae1965-8660-4deb-8427-cafa57f837c8_del complete
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:10:54 user nova-compute[72178]: INFO os_vif [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=55817a06-eb38-4811-a4d8-41aeab256257,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55817a06-eb')
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-3ac1070e-3312-49b9-a781-b213cac93f07 req-4b2a2e1a-179e-4616-a8da-2866a1d7cc27 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3ac1070e-3312-49b9-a781-b213cac93f07 req-4b2a2e1a-179e-4616-a8da-2866a1d7cc27 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3ac1070e-3312-49b9-a781-b213cac93f07 req-4b2a2e1a-179e-4616-a8da-2866a1d7cc27 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3ac1070e-3312-49b9-a781-b213cac93f07 req-4b2a2e1a-179e-4616-a8da-2866a1d7cc27 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-3ac1070e-3312-49b9-a781-b213cac93f07 req-4b2a2e1a-179e-4616-a8da-2866a1d7cc27 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:55 user nova-compute[72178]: WARNING nova.compute.manager [req-3ac1070e-3312-49b9-a781-b213cac93f07 req-4b2a2e1a-179e-4616-a8da-2866a1d7cc27 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state building and task_state spawning.
Aug 01 12:10:55 user nova-compute[72178]: INFO nova.compute.manager [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Took 1.64 seconds to destroy the instance on the hypervisor.
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:10:55 user nova-compute[72178]: INFO nova.compute.manager [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Took 12.46 seconds to build instance.
Aug 01 12:10:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No VIF found with MAC fa:16:3e:6b:33:8a, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-07c253fc-5e6b-4a4d-a476-101ac61ddb8e tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.610s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.907s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.network.neutron [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Updated VIF entry in instance network info cache for port 55817a06-eb38-4811-a4d8-41aeab256257. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.network.neutron [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Updating instance_info_cache with network_info: [{"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d6f25fe-a864-409f-89a6-8cc3d232dd4b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.121s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] Releasing lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received event network-vif-unplugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] Acquiring lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] No waiting events found dispatching network-vif-unplugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-e000a088-9d8a-448a-97d0-43aa83c2d69b req-cdc10c8e-52da-4b97-973a-0c56d8fe343f service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received event network-vif-unplugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-61f8cded-ffd9-4d1c-bc6d-7af0ba656870 req-b8dfe412-31f1-454f-a645-9dcadb3c4b9e service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received event network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-61f8cded-ffd9-4d1c-bc6d-7af0ba656870 req-b8dfe412-31f1-454f-a645-9dcadb3c4b9e service nova] Acquiring lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-61f8cded-ffd9-4d1c-bc6d-7af0ba656870 req-b8dfe412-31f1-454f-a645-9dcadb3c4b9e service nova] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-61f8cded-ffd9-4d1c-bc6d-7af0ba656870 req-b8dfe412-31f1-454f-a645-9dcadb3c4b9e service nova] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-61f8cded-ffd9-4d1c-bc6d-7af0ba656870 req-b8dfe412-31f1-454f-a645-9dcadb3c4b9e service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] No waiting events found dispatching network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:56 user nova-compute[72178]: WARNING nova.compute.manager [req-61f8cded-ffd9-4d1c-bc6d-7af0ba656870 req-b8dfe412-31f1-454f-a645-9dcadb3c4b9e service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received unexpected event network-vif-plugged-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 for instance with vm_state active and task_state deleting.
Aug 01 12:10:56 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:10:56 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Took 1.44 seconds to deallocate network for instance.
Aug 01 12:10:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-a4a97a22-5fa3-4832-8da4-8ee109041071 req-2073428c-5f07-49a6-b110-82c2d7d4b9d1 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received event network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a4a97a22-5fa3-4832-8da4-8ee109041071 req-2073428c-5f07-49a6-b110-82c2d7d4b9d1 service nova] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a4a97a22-5fa3-4832-8da4-8ee109041071 req-2073428c-5f07-49a6-b110-82c2d7d4b9d1 service nova] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a4a97a22-5fa3-4832-8da4-8ee109041071 req-2073428c-5f07-49a6-b110-82c2d7d4b9d1 service nova] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-a4a97a22-5fa3-4832-8da4-8ee109041071 req-2073428c-5f07-49a6-b110-82c2d7d4b9d1 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] No waiting events found dispatching network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:57 user nova-compute[72178]: WARNING nova.compute.manager [req-a4a97a22-5fa3-4832-8da4-8ee109041071 req-2073428c-5f07-49a6-b110-82c2d7d4b9d1 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received unexpected event network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 for instance with vm_state building and task_state spawning.
Aug 01 12:10:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-9a8338da-343c-40e1-b0f8-c1bcbed65d74 req-385bd334-7caa-46c7-8d5f-2cd5b5cc3596 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9a8338da-343c-40e1-b0f8-c1bcbed65d74 req-385bd334-7caa-46c7-8d5f-2cd5b5cc3596 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9a8338da-343c-40e1-b0f8-c1bcbed65d74 req-385bd334-7caa-46c7-8d5f-2cd5b5cc3596 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9a8338da-343c-40e1-b0f8-c1bcbed65d74 req-385bd334-7caa-46c7-8d5f-2cd5b5cc3596 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-9a8338da-343c-40e1-b0f8-c1bcbed65d74 req-385bd334-7caa-46c7-8d5f-2cd5b5cc3596 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:57 user nova-compute[72178]: WARNING nova.compute.manager [req-9a8338da-343c-40e1-b0f8-c1bcbed65d74 req-385bd334-7caa-46c7-8d5f-2cd5b5cc3596 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state building and task_state spawning.
Aug 01 12:10:57 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.812s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:57 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Deleted allocations for instance f4ae1965-8660-4deb-8427-cafa57f837c8
Aug 01 12:10:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-12030891-6a84-4cb5-918a-6d011f6f50e1 tempest-ServerActionsV293TestJSON-1322074 tempest-ServerActionsV293TestJSON-1322074-project-member] Lock "f4ae1965-8660-4deb-8427-cafa57f837c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.162s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891858.3339293, 776b71c1-6696-4575-9c0d-e9340af62167 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:58 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] VM Resumed (Lifecycle Event)
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:10:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance spawned successfully.
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:58 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891858.3362195, 776b71c1-6696-4575-9c0d-e9340af62167 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:58 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] VM Started (Lifecycle Event)
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:10:58 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:10:58 user nova-compute[72178]: INFO nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Took 7.50 seconds to spawn the instance on the hypervisor.
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-5c831164-84a8-4c1a-984f-75fccfd78076 req-cf12b685-be4b-4fec-b209-96ac2f84412b service nova] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Received event network-vif-deleted-ce1a144e-d9df-4bb3-846d-7e0ebffd4373 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:58 user nova-compute[72178]: INFO nova.compute.manager [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Took 29.12 seconds to build instance.
Aug 01 12:10:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ce96f0ff-cb01-40cf-b817-0f0632154e99 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "776b71c1-6696-4575-9c0d-e9340af62167" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.239s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-e0337882-ce0d-4121-90f8-58e130ad4088 req-fd0745d6-1e6f-4459-bf76-2c5d5fe4deba service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received event network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0337882-ce0d-4121-90f8-58e130ad4088 req-fd0745d6-1e6f-4459-bf76-2c5d5fe4deba service nova] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0337882-ce0d-4121-90f8-58e130ad4088 req-fd0745d6-1e6f-4459-bf76-2c5d5fe4deba service nova] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0337882-ce0d-4121-90f8-58e130ad4088 req-fd0745d6-1e6f-4459-bf76-2c5d5fe4deba service nova] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-e0337882-ce0d-4121-90f8-58e130ad4088 req-fd0745d6-1e6f-4459-bf76-2c5d5fe4deba service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] No waiting events found dispatching network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:10:59 user nova-compute[72178]: WARNING nova.compute.manager [req-e0337882-ce0d-4121-90f8-58e130ad4088 req-fd0745d6-1e6f-4459-bf76-2c5d5fe4deba service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received unexpected event network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 for instance with vm_state building and task_state spawning.
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891859.2241826, be40c1ae-0b3e-43c6-804b-ce8158b49233 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] VM Resumed (Lifecycle Event)
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:10:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Instance spawned successfully.
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:10:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891859.2292452, be40c1ae-0b3e-43c6-804b-ce8158b49233 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:10:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] VM Started (Lifecycle Event)
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:10:59 user nova-compute[72178]: INFO nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Took 10.10 seconds to spawn the instance on the hypervisor.
Aug 01 12:10:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:10:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:10:59 user nova-compute[72178]: INFO nova.compute.manager [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Took 11.12 seconds to build instance.
Aug 01 12:10:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-44faa125-2dc4-448c-a748-9be8c82969ec tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.226s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:10:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:02 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891847.4311054, c2b7b3b8-1ed3-4754-9699-16839c7394c7 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:11:02 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] VM Stopped (Lifecycle Event)
Aug 01 12:11:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-23379291-85d4-4b60-bcc1-e924a3591798 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:11:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "d6ab7d82-da92-460f-9172-b635d396513e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "d6ab7d82-da92-460f-9172-b635d396513e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:11:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:11:02 user nova-compute[72178]: INFO nova.compute.claims [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Claim successful on node user
Aug 01 12:11:03 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:11:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:11:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:11:03 user nova-compute[72178]: INFO nova.virt.block_device [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Booting with volume 354f73e0-5d66-4d03-acd9-e4f286fa0e3e at /dev/vda
Aug 01 12:11:03 user nova-compute[72178]: DEBUG nova.policy [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef22394fbdfd4aad8c301596a2ee7b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0eb9e0006c46dabba55cc95cca217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG os_brick.utils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59364cd-d2a5-4001-b4dc-4a562ba28241]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1d40c3-225b-4a2f-bcda-251731c3d3ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edda52e-3d24-4440-80e0-d62f1a134573]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d562ee05-6c79-4b0b-b9da-410b90ce4533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:11:04 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:11:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[572ee8a0-200e-4b9d-b76e-03dae7a73a3f]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG os_brick.utils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Updating existing volume attachment record: 4343918d-294b-465a-83dc-d2b79f257883 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Successfully created port: a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:11:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:05 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Successfully updated port: a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:11:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:11:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquired lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:11:05 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:11:05 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:11:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-18cb3d8e-4d65-4189-a7ad-e241c5a560e1 req-314112e9-a372-44dc-b141-921e2d1884c7 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received event network-changed-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-18cb3d8e-4d65-4189-a7ad-e241c5a560e1 req-314112e9-a372-44dc-b141-921e2d1884c7 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Refreshing instance network info cache due to event network-changed-a424854f-d402-47c0-952b-f405b7e31c4e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:11:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-18cb3d8e-4d65-4189-a7ad-e241c5a560e1 req-314112e9-a372-44dc-b141-921e2d1884c7 service nova] Acquiring lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:11:06 user nova-compute[72178]: DEBUG nova.network.neutron [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Updating instance_info_cache with network_info: [{"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:11:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Releasing lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:11:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Instance network_info: |[{"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:11:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-18cb3d8e-4d65-4189-a7ad-e241c5a560e1 req-314112e9-a372-44dc-b141-921e2d1884c7 service nova] Acquired lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:11:06 user nova-compute[72178]: DEBUG nova.network.neutron [req-18cb3d8e-4d65-4189-a7ad-e241c5a560e1 req-314112e9-a372-44dc-b141-921e2d1884c7 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Refreshing network info cache for port a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:11:06 user nova-compute[72178]: DEBUG nova.network.neutron [req-18cb3d8e-4d65-4189-a7ad-e241c5a560e1 req-314112e9-a372-44dc-b141-921e2d1884c7 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Updated VIF entry in instance network info cache for port a424854f-d402-47c0-952b-f405b7e31c4e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:11:06 user nova-compute[72178]: DEBUG nova.network.neutron [req-18cb3d8e-4d65-4189-a7ad-e241c5a560e1 req-314112e9-a372-44dc-b141-921e2d1884c7 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Updating instance_info_cache with network_info: [{"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:11:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-18cb3d8e-4d65-4189-a7ad-e241c5a560e1 req-314112e9-a372-44dc-b141-921e2d1884c7 service nova] Releasing lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:11:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:09 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891854.7251244, f4ae1965-8660-4deb-8427-cafa57f837c8 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:11:09 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] VM Stopped (Lifecycle Event)
Aug 01 12:11:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c5f0986e-8730-46b7-a1fd-d7f071c3cfb4 None None] [instance: f4ae1965-8660-4deb-8427-cafa57f837c8] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:11:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:11 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:11:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:11:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Creating image(s)
Aug 01 12:11:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:11:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Ensure instance console log exists: /opt/stack/data/nova/instances/d6ab7d82-da92-460f-9172-b635d396513e/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:11:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Start _get_guest_xml network_info=[{"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJHGvYkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6ab7d82-da92-460f-9172-b635d396513e', 'attached_at': '', 'detached_at': '', 'volume_id': '354f73e0-5d66-4d03-acd9-e4f286fa0e3e', 'serial': '354f73e0-5d66-4d03-acd9-e4f286fa0e3e'}, 'boot_index': 0, 'attachment_id': '4343918d-294b-465a-83dc-d2b79f257883', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:11:12 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:11:12 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJHGvYkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:11:12 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:11:12 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:11:12 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c76cb-7838-4116-95ae-090ce3a62bf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:11:12 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a5cfe5-d784-4f7f-9dd5-824ddff63ad0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e] added
Aug 01 12:11:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82074bb-37e1-469f-b555-a105ab6b1dc7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afc057a-fceb-407b-94c8-4ebe91c06685]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJHGvYkA {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LJHGvYkA" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f10c1f8-abcf-49b1-9063-1b401be85d9d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LJHGvYkA'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4b7528-acbd-4152-a8de-9aebf8f68d1f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2346eaa2-119a-4928-8ce4-55e4c70bb5fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:11:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:11:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d02a87d-e2be-454a-a5f3-63a6cec4dce9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e, portal: 172.16.0.220,3260]
Aug 01 12:11:12 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e, portal: 172.16.0.220,3260] successful.
Aug 01 12:11:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a75a4f-d330-4291-80b4-31451ded89c5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0797297-d944-4db8-abc9-e77ebd75aca5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:11:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:11:12 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:11:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[90273087-b0b0-4d9a-bc2a-0e2c2827575e]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJHGvYkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:11:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26432626439613763', 'path': '/dev/sde'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432626439613763', 'path': '/dev/sde'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1393913398',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1393913398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1393913398',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZIbnDKilIJ0qHQWjTpwmP1uzL5R2d7x19G/uW58QgYv9zs5QhDzFx5BdZOGOcgBtWVMb4txS8PlVXG14vfyNqfOrhHmzVGrt4nNxzKGCZ/Y0qnWiEPKrIeHuuXwLAviA==',key_name='tempest-keypair-268238054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-ihg4tp8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=d6ab7d82-da92-460f-9172-b635d396513e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4c:28,bridge_name='br-int',has_traffic_filtering=True,id=a424854f-d402-47c0-952b-f405b7e31c4e,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa424854f-d4') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'pci_devices' on Instance uuid d6ab7d82-da92-460f-9172-b635d396513e {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:11:13 user nova-compute[72178]:   <uuid>d6ab7d82-da92-460f-9172-b635d396513e</uuid>
Aug 01 12:11:13 user nova-compute[72178]:   <name>instance-0000001f</name>
Aug 01 12:11:13 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:11:13 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:11:13 user nova-compute[72178]:   <metadata>
Aug 01 12:11:13 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:11:13 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:11:13 user nova-compute[72178]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1393913398</nova:name>
Aug 01 12:11:13 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:11:12</nova:creationTime>
Aug 01 12:11:13 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:11:13 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:11:13 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:11:13 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:11:13 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:11:13 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:11:13 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:11:13 user nova-compute[72178]:       <nova:owner>
Aug 01 12:11:13 user nova-compute[72178]:         <nova:user uuid="ef22394fbdfd4aad8c301596a2ee7b61">tempest-TestVolumeBootPattern-1003407750-project-member</nova:user>
Aug 01 12:11:13 user nova-compute[72178]:         <nova:project uuid="1e0eb9e0006c46dabba55cc95cca217f">tempest-TestVolumeBootPattern-1003407750</nova:project>
Aug 01 12:11:13 user nova-compute[72178]:       </nova:owner>
Aug 01 12:11:13 user nova-compute[72178]:       <nova:ports>
Aug 01 12:11:13 user nova-compute[72178]:         <nova:port uuid="a424854f-d402-47c0-952b-f405b7e31c4e">
Aug 01 12:11:13 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 12:11:13 user nova-compute[72178]:         </nova:port>
Aug 01 12:11:13 user nova-compute[72178]:       </nova:ports>
Aug 01 12:11:13 user nova-compute[72178]:     </nova:instance>
Aug 01 12:11:13 user nova-compute[72178]:   </metadata>
Aug 01 12:11:13 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:11:13 user nova-compute[72178]:     <system>
Aug 01 12:11:13 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:11:13 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:11:13 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:11:13 user nova-compute[72178]:       <entry name="serial">d6ab7d82-da92-460f-9172-b635d396513e</entry>
Aug 01 12:11:13 user nova-compute[72178]:       <entry name="uuid">d6ab7d82-da92-460f-9172-b635d396513e</entry>
Aug 01 12:11:13 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:11:13 user nova-compute[72178]:     </system>
Aug 01 12:11:13 user nova-compute[72178]:   </sysinfo>
Aug 01 12:11:13 user nova-compute[72178]:   <os>
Aug 01 12:11:13 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:11:13 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:11:13 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:11:13 user nova-compute[72178]:   </os>
Aug 01 12:11:13 user nova-compute[72178]:   <features>
Aug 01 12:11:13 user nova-compute[72178]:     <acpi/>
Aug 01 12:11:13 user nova-compute[72178]:     <apic/>
Aug 01 12:11:13 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:11:13 user nova-compute[72178]:   </features>
Aug 01 12:11:13 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:11:13 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:11:13 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:11:13 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:11:13 user nova-compute[72178]:   </clock>
Aug 01 12:11:13 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:11:13 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:11:13 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:11:13 user nova-compute[72178]:   </cpu>
Aug 01 12:11:13 user nova-compute[72178]:   <devices>
Aug 01 12:11:13 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:11:13 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:11:13 user nova-compute[72178]:       <source dev="/dev/sde"/>
Aug 01 12:11:13 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:11:13 user nova-compute[72178]:       <serial>354f73e0-5d66-4d03-acd9-e4f286fa0e3e</serial>
Aug 01 12:11:13 user nova-compute[72178]:     </disk>
Aug 01 12:11:13 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:11:13 user nova-compute[72178]:       <mac address="fa:16:3e:a6:4c:28"/>
Aug 01 12:11:13 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:11:13 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:11:13 user nova-compute[72178]:       <target dev="tapa424854f-d4"/>
Aug 01 12:11:13 user nova-compute[72178]:     </interface>
Aug 01 12:11:13 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:11:13 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/d6ab7d82-da92-460f-9172-b635d396513e/console.log" append="off"/>
Aug 01 12:11:13 user nova-compute[72178]:     </serial>
Aug 01 12:11:13 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:11:13 user nova-compute[72178]:     <video>
Aug 01 12:11:13 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:11:13 user nova-compute[72178]:     </video>
Aug 01 12:11:13 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:11:13 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:11:13 user nova-compute[72178]:     </rng>
Aug 01 12:11:13 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:11:13 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:11:13 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:11:13 user nova-compute[72178]:     </memballoon>
Aug 01 12:11:13 user nova-compute[72178]:   </devices>
Aug 01 12:11:13 user nova-compute[72178]: </domain>
Aug 01 12:11:13 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1393913398',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1393913398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1393913398',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZIbnDKilIJ0qHQWjTpwmP1uzL5R2d7x19G/uW58QgYv9zs5QhDzFx5BdZOGOcgBtWVMb4txS8PlVXG14vfyNqfOrhHmzVGrt4nNxzKGCZ/Y0qnWiEPKrIeHuuXwLAviA==',key_name='tempest-keypair-268238054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-ihg4tp8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:11:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=d6ab7d82-da92-460f-9172-b635d396513e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4c:28,bridge_name='br-int',has_traffic_filtering=True,id=a424854f-d402-47c0-952b-f405b7e31c4e,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa424854f-d4') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG os_vif [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4c:28,bridge_name='br-int',has_traffic_filtering=True,id=a424854f-d402-47c0-952b-f405b7e31c4e,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa424854f-d4') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa424854f-d4, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa424854f-d4, col_values=(('external_ids', {'iface-id': 'a424854f-d402-47c0-952b-f405b7e31c4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:4c:28', 'vm-uuid': 'd6ab7d82-da92-460f-9172-b635d396513e'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:13 user nova-compute[72178]: INFO os_vif [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:4c:28,bridge_name='br-int',has_traffic_filtering=True,id=a424854f-d402-47c0-952b-f405b7e31c4e,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa424854f-d4')
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:11:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No VIF found with MAC fa:16:3e:a6:4c:28, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:11:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-2d2f6d5f-f9f3-4039-92e9-8634fb991207 req-bc068e68-f466-4d8b-a08c-a7b612ad2ded service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received event network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2d2f6d5f-f9f3-4039-92e9-8634fb991207 req-bc068e68-f466-4d8b-a08c-a7b612ad2ded service nova] Acquiring lock "d6ab7d82-da92-460f-9172-b635d396513e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2d2f6d5f-f9f3-4039-92e9-8634fb991207 req-bc068e68-f466-4d8b-a08c-a7b612ad2ded service nova] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2d2f6d5f-f9f3-4039-92e9-8634fb991207 req-bc068e68-f466-4d8b-a08c-a7b612ad2ded service nova] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-2d2f6d5f-f9f3-4039-92e9-8634fb991207 req-bc068e68-f466-4d8b-a08c-a7b612ad2ded service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] No waiting events found dispatching network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:11:15 user nova-compute[72178]: WARNING nova.compute.manager [req-2d2f6d5f-f9f3-4039-92e9-8634fb991207 req-bc068e68-f466-4d8b-a08c-a7b612ad2ded service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received unexpected event network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e for instance with vm_state building and task_state spawning.
Aug 01 12:11:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891877.2293832, d6ab7d82-da92-460f-9172-b635d396513e => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:11:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] VM Resumed (Lifecycle Event)
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:11:17 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Instance spawned successfully.
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:11:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891877.2333205, d6ab7d82-da92-460f-9172-b635d396513e => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:11:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] VM Started (Lifecycle Event)
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:11:17 user nova-compute[72178]: INFO nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:11:17 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:11:17 user nova-compute[72178]: INFO nova.compute.manager [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Took 14.62 seconds to build instance.
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-796ff8dc-3a08-4378-95dc-05aeffaf1330 req-72ebcf72-16ba-4333-81a5-843235e44df5 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received event network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-796ff8dc-3a08-4378-95dc-05aeffaf1330 req-72ebcf72-16ba-4333-81a5-843235e44df5 service nova] Acquiring lock "d6ab7d82-da92-460f-9172-b635d396513e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-796ff8dc-3a08-4378-95dc-05aeffaf1330 req-72ebcf72-16ba-4333-81a5-843235e44df5 service nova] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-796ff8dc-3a08-4378-95dc-05aeffaf1330 req-72ebcf72-16ba-4333-81a5-843235e44df5 service nova] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-796ff8dc-3a08-4378-95dc-05aeffaf1330 req-72ebcf72-16ba-4333-81a5-843235e44df5 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] No waiting events found dispatching network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:11:17 user nova-compute[72178]: WARNING nova.compute.manager [req-796ff8dc-3a08-4378-95dc-05aeffaf1330 req-72ebcf72-16ba-4333-81a5-843235e44df5 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received unexpected event network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e for instance with vm_state active and task_state None.
Aug 01 12:11:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f6cb67f8-d168-4276-b9ec-aab6ef6800ae tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "d6ab7d82-da92-460f-9172-b635d396513e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.736s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:28 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Going to confirm migration 2 {{(pid=72178) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquired lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'info_cache' on Instance uuid e7e1d3fe-99fe-41fe-bff7-5ea191c529de {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating instance_info_cache with network_info: [{"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Releasing lock "refresh_cache-e7e1d3fe-99fe-41fe-bff7-5ea191c529de" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'migration_context' on Instance uuid e7e1d3fe-99fe-41fe-bff7-5ea191c529de {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:30 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:11:30 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:11:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.473s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:30 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Deleted allocation for migration f592cebb-998a-424c-801f-37467ff955a3
Aug 01 12:11:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0cd9dc06-ad60-4580-8d1e-7dde8c4010e4 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.018s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:33 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:11:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:11:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:11:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:11:34 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updating instance_info_cache with network_info: [{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:11:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:11:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:11:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:11:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.299s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:11:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:11:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:11:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:43 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:11:43 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:11:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=6655MB free_disk=25.09445571899414GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:11:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 45795fb0-12dd-4acc-990c-d1192e1ab54b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e7e1d3fe-99fe-41fe-bff7-5ea191c529de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6341837b-67ea-42df-b3e9-c58e07857774 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 776b71c1-6696-4575-9c0d-e9340af62167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance febae49f-2d0b-4f28-a695-0ecaaf120077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance be40c1ae-0b3e-43c6-804b-ce8158b49233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d6ab7d82-da92-460f-9172-b635d396513e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:11:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:50 user nova-compute[72178]: INFO nova.compute.manager [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Terminating instance
Aug 01 12:11:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-ef24b8c8-1341-459e-a1c7-dfaf40f00236 req-dafe4ffa-0a52-4c3b-a97d-c0f5b2e067e8 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-unplugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ef24b8c8-1341-459e-a1c7-dfaf40f00236 req-dafe4ffa-0a52-4c3b-a97d-c0f5b2e067e8 service nova] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ef24b8c8-1341-459e-a1c7-dfaf40f00236 req-dafe4ffa-0a52-4c3b-a97d-c0f5b2e067e8 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ef24b8c8-1341-459e-a1c7-dfaf40f00236 req-dafe4ffa-0a52-4c3b-a97d-c0f5b2e067e8 service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-ef24b8c8-1341-459e-a1c7-dfaf40f00236 req-dafe4ffa-0a52-4c3b-a97d-c0f5b2e067e8 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] No waiting events found dispatching network-vif-unplugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-ef24b8c8-1341-459e-a1c7-dfaf40f00236 req-dafe4ffa-0a52-4c3b-a97d-c0f5b2e067e8 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-unplugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:11:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Instance destroyed successfully.
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.objects.instance [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'resources' on Instance uuid d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-284171792',display_name='tempest-TestMinimumBasicScenario-server-284171792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-284171792',id=21,image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs8KTalSFvFaNrS1jliZnVrtNwKK4AozywHPcPo+QrbagBuFCxc3RURQwYNZ3xrdIYaSKaentOzwbBBIX4WKQeABSNCDvrrp7zftymG+1qdx+PWxJe8paCRFlMslpcuOw==',key_name='tempest-TestMinimumBasicScenario-121859531',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-suzi3c00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7f47eb43-d82d-4d50-a76b-fe78e3c3a21b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:09:04Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "address": "fa:16:3e:6f:fc:37", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6e7f28c-7e", "ovs_interfaceid": "b6e7f28c-7e67-4026-9f1b-ca5884180e74", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG os_vif [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6e7f28c-7e, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:11:51 user nova-compute[72178]: INFO os_vif [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:fc:37,bridge_name='br-int',has_traffic_filtering=True,id=b6e7f28c-7e67-4026-9f1b-ca5884180e74,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6e7f28c-7e')
Aug 01 12:11:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Deleting instance files /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb_del
Aug 01 12:11:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Deletion of /opt/stack/data/nova/instances/d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb_del complete
Aug 01 12:11:51 user nova-compute[72178]: INFO nova.compute.manager [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 01 12:11:51 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:11:51 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:11:52 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:11:52 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Took 0.69 seconds to deallocate network for instance.
Aug 01 12:11:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-41053ef3-4c2b-4825-9719-1d41b70a5dd6 req-ad67b071-a2b6-4c4b-a203-66bfbfa78de9 service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-deleted-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:52 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:11:52 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:11:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:53 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Deleted allocations for instance d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb
Aug 01 12:11:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-522d2d38-ed2c-433f-82a6-a4e5a6774d78 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.217s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-59d393ce-50e9-4258-833a-03ce1e6233d4 req-9810613c-a109-420c-adba-f1f95716144e service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-59d393ce-50e9-4258-833a-03ce1e6233d4 req-9810613c-a109-420c-adba-f1f95716144e service nova] Acquiring lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-59d393ce-50e9-4258-833a-03ce1e6233d4 req-9810613c-a109-420c-adba-f1f95716144e service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-59d393ce-50e9-4258-833a-03ce1e6233d4 req-9810613c-a109-420c-adba-f1f95716144e service nova] Lock "d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-59d393ce-50e9-4258-833a-03ce1e6233d4 req-9810613c-a109-420c-adba-f1f95716144e service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] No waiting events found dispatching network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:11:53 user nova-compute[72178]: WARNING nova.compute.manager [req-59d393ce-50e9-4258-833a-03ce1e6233d4 req-9810613c-a109-420c-adba-f1f95716144e service nova] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Received unexpected event network-vif-plugged-b6e7f28c-7e67-4026-9f1b-ca5884180e74 for instance with vm_state deleted and task_state None.
Aug 01 12:11:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:55 user nova-compute[72178]: INFO nova.compute.manager [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Terminating instance
Aug 01 12:11:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:11:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-879759d6-0868-43e1-aec8-be06a030da2f req-094e292a-a4d1-4ac2-8898-bd8134b7f5ae service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-unplugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-879759d6-0868-43e1-aec8-be06a030da2f req-094e292a-a4d1-4ac2-8898-bd8134b7f5ae service nova] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-879759d6-0868-43e1-aec8-be06a030da2f req-094e292a-a4d1-4ac2-8898-bd8134b7f5ae service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-879759d6-0868-43e1-aec8-be06a030da2f req-094e292a-a4d1-4ac2-8898-bd8134b7f5ae service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-879759d6-0868-43e1-aec8-be06a030da2f req-094e292a-a4d1-4ac2-8898-bd8134b7f5ae service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] No waiting events found dispatching network-vif-unplugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-879759d6-0868-43e1-aec8-be06a030da2f req-094e292a-a4d1-4ac2-8898-bd8134b7f5ae service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-unplugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:11:56 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Instance destroyed successfully.
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.objects.instance [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lazy-loading 'resources' on Instance uuid 6341837b-67ea-42df-b3e9-c58e07857774 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:06:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1643210725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1643210725',id=19,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjAoXiXijaPgStwNb3E/WYuB63IX6EsfgH4MXYEG8WzG9jHBKzAWMRM5Ek/XHyV/s1ms9GKPP/t84r/7Q/M1HuC5cwkUk7L2lfwOVJUxSaSKKBbJtOUJjYdiD1PNY3xDQ==',key_name='tempest-keypair-1918189647',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:10:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41cc7b29110b4871a9b5c6e0328bdd28',ramdisk_id='',reservation_id='r-4l02fltv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-210279899',owner_user_name='tempest-AttachVolumeShelveTestJSON-210279899-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:10:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='435396a1a5f54338a2af729f1e3f1754',uuid=6341837b-67ea-42df-b3e9-c58e07857774,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converting VIF {"id": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "address": "fa:16:3e:68:2c:07", "network": {"id": "362bcf99-856f-42f6-831e-04eb0ac0e0c2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-2534230-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41cc7b29110b4871a9b5c6e0328bdd28", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape47ac7c6-ea", "ovs_interfaceid": "e47ac7c6-ea8c-4491-9e2a-2e227b2a305a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG os_vif [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape47ac7c6-ea, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:11:56 user nova-compute[72178]: INFO os_vif [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2c:07,bridge_name='br-int',has_traffic_filtering=True,id=e47ac7c6-ea8c-4491-9e2a-2e227b2a305a,network=Network(362bcf99-856f-42f6-831e-04eb0ac0e0c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape47ac7c6-ea')
Aug 01 12:11:56 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Deleting instance files /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774_del
Aug 01 12:11:56 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Deletion of /opt/stack/data/nova/instances/6341837b-67ea-42df-b3e9-c58e07857774_del complete
Aug 01 12:11:56 user nova-compute[72178]: INFO nova.compute.manager [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Took 0.69 seconds to destroy the instance on the hypervisor.
Aug 01 12:11:56 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:11:56 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:11:57 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:11:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:57 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Took 1.39 seconds to deallocate network for instance.
Aug 01 12:11:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-41766842-f14f-4916-9fb7-38047a6735fb req-8a197cb5-68f1-4e51-bee5-f464ad839549 service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-deleted-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:11:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-b7b99252-e68f-4070-a77d-b6cd7898cf81 req-217292b1-f7a3-4ef7-8388-63c09ab6a40f service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:11:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7b99252-e68f-4070-a77d-b6cd7898cf81 req-217292b1-f7a3-4ef7-8388-63c09ab6a40f service nova] Acquiring lock "6341837b-67ea-42df-b3e9-c58e07857774-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:11:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7b99252-e68f-4070-a77d-b6cd7898cf81 req-217292b1-f7a3-4ef7-8388-63c09ab6a40f service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:11:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b7b99252-e68f-4070-a77d-b6cd7898cf81 req-217292b1-f7a3-4ef7-8388-63c09ab6a40f service nova] Lock "6341837b-67ea-42df-b3e9-c58e07857774-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-b7b99252-e68f-4070-a77d-b6cd7898cf81 req-217292b1-f7a3-4ef7-8388-63c09ab6a40f service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] No waiting events found dispatching network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:11:58 user nova-compute[72178]: WARNING nova.compute.manager [req-b7b99252-e68f-4070-a77d-b6cd7898cf81 req-217292b1-f7a3-4ef7-8388-63c09ab6a40f service nova] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Received unexpected event network-vif-plugged-e47ac7c6-ea8c-4491-9e2a-2e227b2a305a for instance with vm_state deleted and task_state None.
Aug 01 12:11:58 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:11:58 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:11:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:11:58 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Deleted allocations for instance 6341837b-67ea-42df-b3e9-c58e07857774
Aug 01 12:11:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-839f9b7e-d260-4863-b50e-225440615b7a tempest-AttachVolumeShelveTestJSON-210279899 tempest-AttachVolumeShelveTestJSON-210279899-project-member] Lock "6341837b-67ea-42df-b3e9-c58e07857774" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.697s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "48f2834c-c573-46cd-98ec-d5d90e721c6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:12:06 user nova-compute[72178]: INFO nova.compute.claims [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Claim successful on node user
Aug 01 12:12:06 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891911.7316906, d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:06 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] VM Stopped (Lifecycle Event)
Aug 01 12:12:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d41312be-317f-40c6-94ca-f229b11014cb None None] [instance: d24e0764-b1cf-4b56-bcfe-73e92ed7c7fb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:12:07 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.policy [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec07389bdd7847469b8376941948997c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a73d8a1944928b14ff263f3a2d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:12:07 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Creating image(s)
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "/opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "/opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "/opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk 1073741824" returned: 0 in 0.056s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Successfully created port: 737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Cannot resize image /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lazy-loading 'migration_context' on Instance uuid 48f2834c-c573-46cd-98ec-d5d90e721c6b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Ensure instance console log exists: /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Successfully updated port: 737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "refresh_cache-48f2834c-c573-46cd-98ec-d5d90e721c6b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquired lock "refresh_cache-48f2834c-c573-46cd-98ec-d5d90e721c6b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-459687f8-4238-4057-8b5b-09275ee9d115 req-49780322-4d74-459e-a815-ae66ffc35e1c service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received event network-changed-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-459687f8-4238-4057-8b5b-09275ee9d115 req-49780322-4d74-459e-a815-ae66ffc35e1c service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Refreshing instance network info cache due to event network-changed-737a7e5c-d588-4fe6-8e31-b96c4191f14c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-459687f8-4238-4057-8b5b-09275ee9d115 req-49780322-4d74-459e-a815-ae66ffc35e1c service nova] Acquiring lock "refresh_cache-48f2834c-c573-46cd-98ec-d5d90e721c6b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Updating instance_info_cache with network_info: [{"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Releasing lock "refresh_cache-48f2834c-c573-46cd-98ec-d5d90e721c6b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Instance network_info: |[{"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-459687f8-4238-4057-8b5b-09275ee9d115 req-49780322-4d74-459e-a815-ae66ffc35e1c service nova] Acquired lock "refresh_cache-48f2834c-c573-46cd-98ec-d5d90e721c6b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-459687f8-4238-4057-8b5b-09275ee9d115 req-49780322-4d74-459e-a815-ae66ffc35e1c service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Refreshing network info cache for port 737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Start _get_guest_xml network_info=[{"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:12:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:08 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-185703279',display_name='tempest-VolumesActionsTest-instance-185703279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-185703279',id=32,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e82a73d8a1944928b14ff263f3a2d385',ramdisk_id='',reservation_id='r-yhpnwka5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-439234941',owner_user_name='tempest-VolumesActionsTest-439234941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:12:07Z,user_data=None,user_id='ec07389bdd7847469b8376941948997c',uuid=48f2834c-c573-46cd-98ec-d5d90e721c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converting VIF {"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:14,bridge_name='br-int',has_traffic_filtering=True,id=737a7e5c-d588-4fe6-8e31-b96c4191f14c,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a7e5c-d5') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lazy-loading 'pci_devices' on Instance uuid 48f2834c-c573-46cd-98ec-d5d90e721c6b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:12:08 user nova-compute[72178]:   <uuid>48f2834c-c573-46cd-98ec-d5d90e721c6b</uuid>
Aug 01 12:12:08 user nova-compute[72178]:   <name>instance-00000020</name>
Aug 01 12:12:08 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:12:08 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:12:08 user nova-compute[72178]:   <metadata>
Aug 01 12:12:08 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:12:08 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:12:08 user nova-compute[72178]:       <nova:name>tempest-VolumesActionsTest-instance-185703279</nova:name>
Aug 01 12:12:08 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:12:08</nova:creationTime>
Aug 01 12:12:08 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:12:08 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:12:08 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:12:08 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:12:08 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:12:08 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:12:08 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:12:08 user nova-compute[72178]:       <nova:owner>
Aug 01 12:12:08 user nova-compute[72178]:         <nova:user uuid="ec07389bdd7847469b8376941948997c">tempest-VolumesActionsTest-439234941-project-member</nova:user>
Aug 01 12:12:08 user nova-compute[72178]:         <nova:project uuid="e82a73d8a1944928b14ff263f3a2d385">tempest-VolumesActionsTest-439234941</nova:project>
Aug 01 12:12:08 user nova-compute[72178]:       </nova:owner>
Aug 01 12:12:08 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:12:08 user nova-compute[72178]:       <nova:ports>
Aug 01 12:12:08 user nova-compute[72178]:         <nova:port uuid="737a7e5c-d588-4fe6-8e31-b96c4191f14c">
Aug 01 12:12:08 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 12:12:08 user nova-compute[72178]:         </nova:port>
Aug 01 12:12:08 user nova-compute[72178]:       </nova:ports>
Aug 01 12:12:08 user nova-compute[72178]:     </nova:instance>
Aug 01 12:12:08 user nova-compute[72178]:   </metadata>
Aug 01 12:12:08 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:12:08 user nova-compute[72178]:     <system>
Aug 01 12:12:08 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:12:08 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:12:08 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:12:08 user nova-compute[72178]:       <entry name="serial">48f2834c-c573-46cd-98ec-d5d90e721c6b</entry>
Aug 01 12:12:08 user nova-compute[72178]:       <entry name="uuid">48f2834c-c573-46cd-98ec-d5d90e721c6b</entry>
Aug 01 12:12:08 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:12:08 user nova-compute[72178]:     </system>
Aug 01 12:12:08 user nova-compute[72178]:   </sysinfo>
Aug 01 12:12:08 user nova-compute[72178]:   <os>
Aug 01 12:12:08 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:12:08 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:12:08 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:12:08 user nova-compute[72178]:   </os>
Aug 01 12:12:08 user nova-compute[72178]:   <features>
Aug 01 12:12:08 user nova-compute[72178]:     <acpi/>
Aug 01 12:12:08 user nova-compute[72178]:     <apic/>
Aug 01 12:12:08 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:12:08 user nova-compute[72178]:   </features>
Aug 01 12:12:08 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:12:08 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:12:08 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:12:08 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:12:08 user nova-compute[72178]:   </clock>
Aug 01 12:12:08 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:12:08 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:12:08 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:12:08 user nova-compute[72178]:   </cpu>
Aug 01 12:12:08 user nova-compute[72178]:   <devices>
Aug 01 12:12:08 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:12:08 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:12:08 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk"/>
Aug 01 12:12:08 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:12:08 user nova-compute[72178]:     </disk>
Aug 01 12:12:08 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:12:08 user nova-compute[72178]:       <mac address="fa:16:3e:af:49:14"/>
Aug 01 12:12:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:12:08 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:12:08 user nova-compute[72178]:       <target dev="tap737a7e5c-d5"/>
Aug 01 12:12:08 user nova-compute[72178]:     </interface>
Aug 01 12:12:08 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:12:08 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/console.log" append="off"/>
Aug 01 12:12:08 user nova-compute[72178]:     </serial>
Aug 01 12:12:08 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:12:08 user nova-compute[72178]:     <video>
Aug 01 12:12:08 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:12:08 user nova-compute[72178]:     </video>
Aug 01 12:12:08 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:12:08 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:12:08 user nova-compute[72178]:     </rng>
Aug 01 12:12:08 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:12:08 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:12:08 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:12:08 user nova-compute[72178]:     </memballoon>
Aug 01 12:12:08 user nova-compute[72178]:   </devices>
Aug 01 12:12:08 user nova-compute[72178]: </domain>
Aug 01 12:12:08 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-185703279',display_name='tempest-VolumesActionsTest-instance-185703279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-185703279',id=32,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e82a73d8a1944928b14ff263f3a2d385',ramdisk_id='',reservation_id='r-yhpnwka5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-439234941',owner_user_name='tempest-VolumesActionsTest-439234941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:12:07Z,user_data=None,user_id='ec07389bdd7847469b8376941948997c',uuid=48f2834c-c573-46cd-98ec-d5d90e721c6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converting VIF {"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:14,bridge_name='br-int',has_traffic_filtering=True,id=737a7e5c-d588-4fe6-8e31-b96c4191f14c,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a7e5c-d5') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG os_vif [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:14,bridge_name='br-int',has_traffic_filtering=True,id=737a7e5c-d588-4fe6-8e31-b96c4191f14c,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a7e5c-d5') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap737a7e5c-d5, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap737a7e5c-d5, col_values=(('external_ids', {'iface-id': '737a7e5c-d588-4fe6-8e31-b96c4191f14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:49:14', 'vm-uuid': '48f2834c-c573-46cd-98ec-d5d90e721c6b'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:12:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:08 user nova-compute[72178]: INFO os_vif [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:14,bridge_name='br-int',has_traffic_filtering=True,id=737a7e5c-d588-4fe6-8e31-b96c4191f14c,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a7e5c-d5')
Aug 01 12:12:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] No VIF found with MAC fa:16:3e:af:49:14, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:12:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-459687f8-4238-4057-8b5b-09275ee9d115 req-49780322-4d74-459e-a815-ae66ffc35e1c service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Updated VIF entry in instance network info cache for port 737a7e5c-d588-4fe6-8e31-b96c4191f14c. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:12:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-459687f8-4238-4057-8b5b-09275ee9d115 req-49780322-4d74-459e-a815-ae66ffc35e1c service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Updating instance_info_cache with network_info: [{"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-459687f8-4238-4057-8b5b-09275ee9d115 req-49780322-4d74-459e-a815-ae66ffc35e1c service nova] Releasing lock "refresh_cache-48f2834c-c573-46cd-98ec-d5d90e721c6b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG nova.compute.manager [req-258b896d-5a8f-4d36-89c2-542057ec4364 req-e32c3c01-732a-410d-b2b2-59aae55eebdf service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received event network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-258b896d-5a8f-4d36-89c2-542057ec4364 req-e32c3c01-732a-410d-b2b2-59aae55eebdf service nova] Acquiring lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-258b896d-5a8f-4d36-89c2-542057ec4364 req-e32c3c01-732a-410d-b2b2-59aae55eebdf service nova] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-258b896d-5a8f-4d36-89c2-542057ec4364 req-e32c3c01-732a-410d-b2b2-59aae55eebdf service nova] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG nova.compute.manager [req-258b896d-5a8f-4d36-89c2-542057ec4364 req-e32c3c01-732a-410d-b2b2-59aae55eebdf service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] No waiting events found dispatching network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:10 user nova-compute[72178]: WARNING nova.compute.manager [req-258b896d-5a8f-4d36-89c2-542057ec4364 req-e32c3c01-732a-410d-b2b2-59aae55eebdf service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received unexpected event network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c for instance with vm_state building and task_state spawning.
Aug 01 12:12:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:11 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891916.37043, 6341837b-67ea-42df-b3e9-c58e07857774 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:11 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] VM Stopped (Lifecycle Event)
Aug 01 12:12:11 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c896a1f8-e9e7-4107-9cd6-ce63919744a8 None None] [instance: 6341837b-67ea-42df-b3e9-c58e07857774] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891932.4964194, 48f2834c-c573-46cd-98ec-d5d90e721c6b => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:12 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] VM Resumed (Lifecycle Event)
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:12:12 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Instance spawned successfully.
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:12 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891932.4978228, 48f2834c-c573-46cd-98ec-d5d90e721c6b => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:12 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] VM Started (Lifecycle Event)
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-bbecac3c-fd55-480a-a9c7-b041c20cd49f req-e300e650-5098-4d14-9b75-bb146725a2b5 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received event network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbecac3c-fd55-480a-a9c7-b041c20cd49f req-e300e650-5098-4d14-9b75-bb146725a2b5 service nova] Acquiring lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbecac3c-fd55-480a-a9c7-b041c20cd49f req-e300e650-5098-4d14-9b75-bb146725a2b5 service nova] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbecac3c-fd55-480a-a9c7-b041c20cd49f req-e300e650-5098-4d14-9b75-bb146725a2b5 service nova] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-bbecac3c-fd55-480a-a9c7-b041c20cd49f req-e300e650-5098-4d14-9b75-bb146725a2b5 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] No waiting events found dispatching network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:12 user nova-compute[72178]: WARNING nova.compute.manager [req-bbecac3c-fd55-480a-a9c7-b041c20cd49f req-e300e650-5098-4d14-9b75-bb146725a2b5 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received unexpected event network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c for instance with vm_state building and task_state spawning.
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:12:12 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:12:12 user nova-compute[72178]: INFO nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Took 5.44 seconds to spawn the instance on the hypervisor.
Aug 01 12:12:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:12 user nova-compute[72178]: INFO nova.compute.manager [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Took 6.26 seconds to build instance.
Aug 01 12:12:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3134bab5-407f-4dac-96b7-ec5f32c1760b tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.361s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:20 user nova-compute[72178]: INFO nova.compute.manager [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Rescuing
Aug 01 12:12:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquired lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:20 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:12:20 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Updating instance_info_cache with network_info: [{"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Releasing lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-0e7a6470-0e25-427b-86cc-6136e15ec6af req-9b553358-45cb-425e-beef-95c706c71a54 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0e7a6470-0e25-427b-86cc-6136e15ec6af req-9b553358-45cb-425e-beef-95c706c71a54 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0e7a6470-0e25-427b-86cc-6136e15ec6af req-9b553358-45cb-425e-beef-95c706c71a54 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0e7a6470-0e25-427b-86cc-6136e15ec6af req-9b553358-45cb-425e-beef-95c706c71a54 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-0e7a6470-0e25-427b-86cc-6136e15ec6af req-9b553358-45cb-425e-beef-95c706c71a54 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:21 user nova-compute[72178]: WARNING nova.compute.manager [req-0e7a6470-0e25-427b-86cc-6136e15ec6af req-9b553358-45cb-425e-beef-95c706c71a54 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state active and task_state rescuing.
Aug 01 12:12:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance destroyed successfully.
Aug 01 12:12:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Attempting a stable device rescue
Aug 01 12:12:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72178) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance directory exists: not creating {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 01 12:12:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Creating image(s)
Aug 01 12:12:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "/opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "/opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "/opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'trusted_certs' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "9b14ee739bc6d42a712e62f5a22d53b8e9be56b8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "9b14ee739bc6d42a712e62f5a22d53b8e9be56b8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8.part --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:22 user nova-compute[72178]: DEBUG nova.virt.images [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] be41b1d9-4bb2-47d3-aa09-5568699a8b93 was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 12:12:22 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:12:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8.part /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.compute.manager [req-e1dc0ef7-7a21-4320-9f10-019ba60e0c91 req-2207b16f-ba67-4170-a284-3a0920bacc23 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e1dc0ef7-7a21-4320-9f10-019ba60e0c91 req-2207b16f-ba67-4170-a284-3a0920bacc23 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e1dc0ef7-7a21-4320-9f10-019ba60e0c91 req-2207b16f-ba67-4170-a284-3a0920bacc23 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e1dc0ef7-7a21-4320-9f10-019ba60e0c91 req-2207b16f-ba67-4170-a284-3a0920bacc23 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.compute.manager [req-e1dc0ef7-7a21-4320-9f10-019ba60e0c91 req-2207b16f-ba67-4170-a284-3a0920bacc23 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:23 user nova-compute[72178]: WARNING nova.compute.manager [req-e1dc0ef7-7a21-4320-9f10-019ba60e0c91 req-2207b16f-ba67-4170-a284-3a0920bacc23 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state active and task_state rescuing.
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8.part /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8.converted" returned: 0 in 0.466s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "9b14ee739bc6d42a712e62f5a22d53b8e9be56b8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.881s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "9b14ee739bc6d42a712e62f5a22d53b8e9be56b8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "9b14ee739bc6d42a712e62f5a22d53b8e9be56b8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8 --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8,backing_fmt=raw /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8,backing_fmt=raw /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue" returned: 0 in 0.048s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "9b14ee739bc6d42a712e62f5a22d53b8e9be56b8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'migration_context' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Start _get_guest_xml network_info=[{"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "vif_mac": "fa:16:3e:d6:6b:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'be41b1d9-4bb2-47d3-aa09-5568699a8b93', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HClEGrQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '776b71c1-6696-4575-9c0d-e9340af62167', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2e04741-b105-4a08-a399-d496e798a21f', 'serial': 'e2e04741-b105-4a08-a399-d496e798a21f'}, 'boot_index': 0, 'attachment_id': 'cd644bbf-9c5d-49e7-a5e7-796ed0e4cca2', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'resources' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'numa_topology' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:23 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:23 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'vcpu_model' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HClEGrQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:12:23 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:12:23 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:12:23 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c5bbf-956f-4562-ba7e-46bef8c0c51c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HClEGrQu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 01 12:12:23 user nova-compute[72178]: node.name = iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f
Aug 01 12:12:23 user nova-compute[72178]: node.tpgt = -1
Aug 01 12:12:23 user nova-compute[72178]: node.startup = automatic
Aug 01 12:12:23 user nova-compute[72178]: node.leading_login = No
Aug 01 12:12:23 user nova-compute[72178]: iface.iscsi_ifacename = default
Aug 01 12:12:23 user nova-compute[72178]: iface.net_ifacename = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.ipaddress = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.prefix_len = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.hwaddress = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.transport_name = tcp
Aug 01 12:12:23 user nova-compute[72178]: iface.initiatorname = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.state = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.vlan_id = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.vlan_priority = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.vlan_state = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.iface_num = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.mtu = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.port = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.bootproto = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.subnet_mask = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.gateway = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.dhcp_alt_client_id_state = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.dhcp_alt_client_id = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.dhcp_dns = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.dhcp_learn_iqn = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.dhcp_req_vendor_id_state = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.dhcp_vendor_id_state = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.dhcp_vendor_id = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.dhcp_slp_da = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.fragmentation = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.gratuitous_arp = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.incoming_forwarding = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.tos_state = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.tos = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.ttl = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.delayed_ack = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.tcp_nagle = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.tcp_wsf_state = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.tcp_wsf = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.tcp_timer_scale = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.tcp_timestamp = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.redirect = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.def_task_mgmt_timeout = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.header_digest = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.data_digest = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.immediate_data = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.initial_r2t = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.data_seq_inorder = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.data_pdu_inorder = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.erl = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.max_receive_data_len = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.first_burst_len = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.max_outstanding_r2t = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.max_burst_len = 0
Aug 01 12:12:23 user nova-compute[72178]: iface.chap_auth = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.bidi_chap = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.strict_login_compliance = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.discovery_auth = <empty>
Aug 01 12:12:23 user nova-compute[72178]: iface.discovery_logout = <empty>
Aug 01 12:12:23 user nova-compute[72178]: node.discovery_address = <empty>
Aug 01 12:12:23 user nova-compute[72178]: node.discovery_port = 0
Aug 01 12:12:23 user nova-compute[72178]: node.discovery_type = static
Aug 01 12:12:23 user nova-compute[72178]: node.session.initial_cmdsn = 0
Aug 01 12:12:23 user nova-compute[72178]: node.session.initial_login_retry_max = 8
Aug 01 12:12:23 user nova-compute[72178]: node.session.xmit_thread_priority = -20
Aug 01 12:12:23 user nova-compute[72178]: node.session.cmds_max = 128
Aug 01 12:12:23 user nova-compute[72178]: node.session.queue_depth = 32
Aug 01 12:12:23 user nova-compute[72178]: node.session.nr_sessions = 1
Aug 01 12:12:23 user nova-compute[72178]: node.session.auth.authmethod = CHAP
Aug 01 12:12:23 user nova-compute[72178]: node.session.auth.username = HClEGrQu
Aug 01 12:12:23 user nova-compute[72178]: node.session.auth.password = ***
Aug 01 12:12:23 user nova-compute[72178]: node.session.auth.username_in = <empty>
Aug 01 12:12:23 user nova-compute[72178]: node.session.auth.password_in = <empty>
Aug 01 12:12:23 user nova-compute[72178]: node.session.auth.chap_algs = MD5
Aug 01 12:12:23 user nova-compute[72178]: node.session.timeo.replacement_timeout = 120
Aug 01 12:12:23 user nova-compute[72178]: node.session.err_timeo.abort_timeout = 15
Aug 01 12:12:23 user nova-compute[72178]: node.session.err_timeo.lu_reset_timeout = 30
Aug 01 12:12:23 user nova-compute[72178]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 01 12:12:23 user nova-compute[72178]: node.session.err_timeo.host_reset_timeout = 60
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.FastAbort = Yes
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.InitialR2T = No
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.ImmediateData = Yes
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.FirstBurstLength = 262144
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.MaxBurstLength = 16776192
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.DefaultTime2Retain = 0
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.DefaultTime2Wait = 2
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.MaxConnections = 1
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 01 12:12:23 user nova-compute[72178]: node.session.iscsi.ERL = 0
Aug 01 12:12:23 user nova-compute[72178]: node.session.scan = manual
Aug 01 12:12:23 user nova-compute[72178]: node.session.reopen_max = 0
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].address = 172.16.0.220
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].port = 3260
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].startup = manual
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].tcp.window_size = 524288
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].tcp.type_of_service = 0
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].timeo.logout_timeout = 15
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].timeo.login_timeout = 15
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].timeo.auth_timeout = 45
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].timeo.noop_out_interval = 5
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].timeo.noop_out_timeout = 5
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].iscsi.HeaderDigest = None
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].iscsi.DataDigest = None
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].iscsi.IFMarker = No
Aug 01 12:12:23 user nova-compute[72178]: node.conn[0].iscsi.OFMarker = No
Aug 01 12:12:23 user nova-compute[72178]: # END RECORD
Aug 01 12:12:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd48ca6d-ead9-46b0-b78f-2ae3daf0f460]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dffab4-c406-4dfa-ab99-f3e868bf2ce7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HClEGrQu {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HClEGrQu" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733ba62-1479-4f72-95e8-09d1300e83ad]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HClEGrQu'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf09bae-13c7-4717-9c32-302065df6b3f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51657b2-c146-4dff-942e-114cc7da49e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:23 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:23 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:23 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:23 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:23 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:23 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] HCTL ('35', '0', '0', 0) found on session 33 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:12:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e9ddce-577a-4e5a-9b6a-ec7c4d5b326b]: (4, ('0 0 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Searching for a device in session 33 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HClEGrQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.177s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '26238656535383638', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238656535383638', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-136494262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-136494262',id=28,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:10:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-ddvy2rh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:10:59Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=776b71c1-6696-4575-9c0d-e9340af62167,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "vif_mac": "fa:16:3e:d6:6b:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "vif_mac": "fa:16:3e:d6:6b:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=e9f19544-b04e-4449-924c-7925cf503a56,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f19544-b0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'pci_devices' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:12:24 user nova-compute[72178]:   <uuid>776b71c1-6696-4575-9c0d-e9340af62167</uuid>
Aug 01 12:12:24 user nova-compute[72178]:   <name>instance-0000001c</name>
Aug 01 12:12:24 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:12:24 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:12:24 user nova-compute[72178]:   <metadata>
Aug 01 12:12:24 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:12:24 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:12:24 user nova-compute[72178]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-136494262</nova:name>
Aug 01 12:12:24 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:12:23</nova:creationTime>
Aug 01 12:12:24 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:12:24 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:12:24 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:12:24 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:12:24 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:12:24 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:12:24 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:12:24 user nova-compute[72178]:       <nova:owner>
Aug 01 12:12:24 user nova-compute[72178]:         <nova:user uuid="ec0992e3a27a4a44922268a46b27ad83">tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member</nova:user>
Aug 01 12:12:24 user nova-compute[72178]:         <nova:project uuid="d5e2fc3212d24561b0b971241fe367ec">tempest-ServerBootFromVolumeStableRescueTest-2013636577</nova:project>
Aug 01 12:12:24 user nova-compute[72178]:       </nova:owner>
Aug 01 12:12:24 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:12:24 user nova-compute[72178]:       <nova:ports>
Aug 01 12:12:24 user nova-compute[72178]:         <nova:port uuid="e9f19544-b04e-4449-924c-7925cf503a56">
Aug 01 12:12:24 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 01 12:12:24 user nova-compute[72178]:         </nova:port>
Aug 01 12:12:24 user nova-compute[72178]:       </nova:ports>
Aug 01 12:12:24 user nova-compute[72178]:     </nova:instance>
Aug 01 12:12:24 user nova-compute[72178]:   </metadata>
Aug 01 12:12:24 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:12:24 user nova-compute[72178]:     <system>
Aug 01 12:12:24 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:12:24 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:12:24 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:12:24 user nova-compute[72178]:       <entry name="serial">776b71c1-6696-4575-9c0d-e9340af62167</entry>
Aug 01 12:12:24 user nova-compute[72178]:       <entry name="uuid">776b71c1-6696-4575-9c0d-e9340af62167</entry>
Aug 01 12:12:24 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:12:24 user nova-compute[72178]:     </system>
Aug 01 12:12:24 user nova-compute[72178]:   </sysinfo>
Aug 01 12:12:24 user nova-compute[72178]:   <os>
Aug 01 12:12:24 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:12:24 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:12:24 user nova-compute[72178]:   </os>
Aug 01 12:12:24 user nova-compute[72178]:   <features>
Aug 01 12:12:24 user nova-compute[72178]:     <acpi/>
Aug 01 12:12:24 user nova-compute[72178]:     <apic/>
Aug 01 12:12:24 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:12:24 user nova-compute[72178]:   </features>
Aug 01 12:12:24 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:12:24 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:12:24 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:12:24 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:12:24 user nova-compute[72178]:   </clock>
Aug 01 12:12:24 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:12:24 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:12:24 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:12:24 user nova-compute[72178]:   </cpu>
Aug 01 12:12:24 user nova-compute[72178]:   <devices>
Aug 01 12:12:24 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:12:24 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:12:24 user nova-compute[72178]:       <source dev="/dev/sdd"/>
Aug 01 12:12:24 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:12:24 user nova-compute[72178]:       <serial>e2e04741-b105-4a08-a399-d496e798a21f</serial>
Aug 01 12:12:24 user nova-compute[72178]:     </disk>
Aug 01 12:12:24 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:12:24 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:12:24 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue"/>
Aug 01 12:12:24 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:12:24 user nova-compute[72178]:       <boot order="1"/>
Aug 01 12:12:24 user nova-compute[72178]:     </disk>
Aug 01 12:12:24 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:12:24 user nova-compute[72178]:       <mac address="fa:16:3e:d6:6b:b7"/>
Aug 01 12:12:24 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:12:24 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:12:24 user nova-compute[72178]:       <target dev="tape9f19544-b0"/>
Aug 01 12:12:24 user nova-compute[72178]:     </interface>
Aug 01 12:12:24 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:12:24 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/console.log" append="off"/>
Aug 01 12:12:24 user nova-compute[72178]:     </serial>
Aug 01 12:12:24 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:12:24 user nova-compute[72178]:     <video>
Aug 01 12:12:24 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:12:24 user nova-compute[72178]:     </video>
Aug 01 12:12:24 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:12:24 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:12:24 user nova-compute[72178]:     </rng>
Aug 01 12:12:24 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:12:24 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:12:24 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:12:24 user nova-compute[72178]:     </memballoon>
Aug 01 12:12:24 user nova-compute[72178]:   </devices>
Aug 01 12:12:24 user nova-compute[72178]: </domain>
Aug 01 12:12:24 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:12:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance destroyed successfully.
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] No VIF found with MAC fa:16:3e:d6:6b:b7, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG nova.compute.manager [req-a513992f-30d1-44f6-a97c-7ce9b816145f req-99d36281-6615-4ca5-a5ad-3056b29d2508 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a513992f-30d1-44f6-a97c-7ce9b816145f req-99d36281-6615-4ca5-a5ad-3056b29d2508 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a513992f-30d1-44f6-a97c-7ce9b816145f req-99d36281-6615-4ca5-a5ad-3056b29d2508 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a513992f-30d1-44f6-a97c-7ce9b816145f req-99d36281-6615-4ca5-a5ad-3056b29d2508 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG nova.compute.manager [req-a513992f-30d1-44f6-a97c-7ce9b816145f req-99d36281-6615-4ca5-a5ad-3056b29d2508 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:25 user nova-compute[72178]: WARNING nova.compute.manager [req-a513992f-30d1-44f6-a97c-7ce9b816145f req-99d36281-6615-4ca5-a5ad-3056b29d2508 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state active and task_state rescuing.
Aug 01 12:12:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for 776b71c1-6696-4575-9c0d-e9340af62167 due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891947.6764185, 776b71c1-6696-4575-9c0d-e9340af62167 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] VM Resumed (Lifecycle Event)
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bd4f900a-62bd-4662-88ef-3e228b945329 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-1798d52f-342c-487f-8d54-c307dcf4234e req-b5949a01-92a9-4f6b-b48d-bc3897b46f86 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1798d52f-342c-487f-8d54-c307dcf4234e req-b5949a01-92a9-4f6b-b48d-bc3897b46f86 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1798d52f-342c-487f-8d54-c307dcf4234e req-b5949a01-92a9-4f6b-b48d-bc3897b46f86 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1798d52f-342c-487f-8d54-c307dcf4234e req-b5949a01-92a9-4f6b-b48d-bc3897b46f86 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-1798d52f-342c-487f-8d54-c307dcf4234e req-b5949a01-92a9-4f6b-b48d-bc3897b46f86 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:27 user nova-compute[72178]: WARNING nova.compute.manager [req-1798d52f-342c-487f-8d54-c307dcf4234e req-b5949a01-92a9-4f6b-b48d-bc3897b46f86 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state active and task_state rescuing.
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:12:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891947.6785173, 776b71c1-6696-4575-9c0d-e9340af62167 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] VM Started (Lifecycle Event)
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:12:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG nova.compute.manager [req-c8ea5fcb-26c1-4345-9fd6-698f2d7c4f4f req-c557b894-b30f-4a8c-bb7c-c0fca8ad0542 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received event network-changed-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG nova.compute.manager [req-c8ea5fcb-26c1-4345-9fd6-698f2d7c4f4f req-c557b894-b30f-4a8c-bb7c-c0fca8ad0542 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Refreshing instance network info cache due to event network-changed-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c8ea5fcb-26c1-4345-9fd6-698f2d7c4f4f req-c557b894-b30f-4a8c-bb7c-c0fca8ad0542 service nova] Acquiring lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c8ea5fcb-26c1-4345-9fd6-698f2d7c4f4f req-c557b894-b30f-4a8c-bb7c-c0fca8ad0542 service nova] Acquired lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-c8ea5fcb-26c1-4345-9fd6-698f2d7c4f4f req-c557b894-b30f-4a8c-bb7c-c0fca8ad0542 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Refreshing network info cache for port 8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-c8ea5fcb-26c1-4345-9fd6-698f2d7c4f4f req-c557b894-b30f-4a8c-bb7c-c0fca8ad0542 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updated VIF entry in instance network info cache for port 8ed79e30-ec8c-4ab4-9447-738d5d07cdbc. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-c8ea5fcb-26c1-4345-9fd6-698f2d7c4f4f req-c557b894-b30f-4a8c-bb7c-c0fca8ad0542 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating instance_info_cache with network_info: [{"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c8ea5fcb-26c1-4345-9fd6-698f2d7c4f4f req-c557b894-b30f-4a8c-bb7c-c0fca8ad0542 service nova] Releasing lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:34 user nova-compute[72178]: INFO nova.compute.manager [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Terminating instance
Aug 01 12:12:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-909403b3-5588-4395-8533-2ca89adb9430 req-73559d44-e9cc-4285-91b2-a363b55d014a service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-unplugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-909403b3-5588-4395-8533-2ca89adb9430 req-73559d44-e9cc-4285-91b2-a363b55d014a service nova] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-909403b3-5588-4395-8533-2ca89adb9430 req-73559d44-e9cc-4285-91b2-a363b55d014a service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-909403b3-5588-4395-8533-2ca89adb9430 req-73559d44-e9cc-4285-91b2-a363b55d014a service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-909403b3-5588-4395-8533-2ca89adb9430 req-73559d44-e9cc-4285-91b2-a363b55d014a service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] No waiting events found dispatching network-vif-unplugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-909403b3-5588-4395-8533-2ca89adb9430 req-73559d44-e9cc-4285-91b2-a363b55d014a service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-unplugged-56751746-774a-4955-a547-c09eff25e5b5 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Instance destroyed successfully.
Aug 01 12:12:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'resources' on Instance uuid 45795fb0-12dd-4acc-990c-d1192e1ab54b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2004812366',display_name='tempest-ServerRescueNegativeTestJSON-server-2004812366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2004812366',id=23,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbBYsqJ9jde0PSiVyxKEVdLH1IKsqZ/24z3X+71JN8pEHFQwCCa9axMDxJod/5q+2BU2do9Sc0gEcxKbZZXkJ38MVPEo7SP0XWZq33JT0yJWyWZJA33Lwfbje5GLqCm1A==',key_name='tempest-keypair-72150570',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-vujhbl6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=45795fb0-12dd-4acc-990c-d1192e1ab54b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "56751746-774a-4955-a547-c09eff25e5b5", "address": "fa:16:3e:44:5a:c7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56751746-77", "ovs_interfaceid": "56751746-774a-4955-a547-c09eff25e5b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:5a:c7,bridge_name='br-int',has_traffic_filtering=True,id=56751746-774a-4955-a547-c09eff25e5b5,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56751746-77') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG os_vif [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:5a:c7,bridge_name='br-int',has_traffic_filtering=True,id=56751746-774a-4955-a547-c09eff25e5b5,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56751746-77') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56751746-77, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:12:35 user nova-compute[72178]: INFO os_vif [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:5a:c7,bridge_name='br-int',has_traffic_filtering=True,id=56751746-774a-4955-a547-c09eff25e5b5,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56751746-77')
Aug 01 12:12:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Deleting instance files /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b_del
Aug 01 12:12:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Deletion of /opt/stack/data/nova/instances/45795fb0-12dd-4acc-990c-d1192e1ab54b_del complete
Aug 01 12:12:35 user nova-compute[72178]: INFO nova.compute.manager [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 01 12:12:35 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] No waiting events found dispatching network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:36 user nova-compute[72178]: WARNING nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received unexpected event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 for instance with vm_state active and task_state deleting.
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] No waiting events found dispatching network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:36 user nova-compute[72178]: WARNING nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received unexpected event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 for instance with vm_state active and task_state deleting.
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] No waiting events found dispatching network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:36 user nova-compute[72178]: WARNING nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received unexpected event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 for instance with vm_state active and task_state deleting.
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-unplugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] No waiting events found dispatching network-vif-unplugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9eca5e4-a3c2-42a3-8091-8fb7cb8ac498 req-12bed2e3-d2a8-450f-b114-2268a6cec086 service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-unplugged-56751746-774a-4955-a547-c09eff25e5b5 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:12:36 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:36 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Took 1.77 seconds to deallocate network for instance.
Aug 01 12:12:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:37 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:12:37 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:12:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:37 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Deleted allocations for instance 45795fb0-12dd-4acc-990c-d1192e1ab54b
Aug 01 12:12:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-653168a2-c592-49a3-9a3a-bbd39cfd758d tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.447s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:38 user nova-compute[72178]: INFO nova.compute.manager [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Unshelving
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:38 user nova-compute[72178]: INFO nova.virt.block_device [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Booting with volume fa4dbd87-fe59-416b-ac59-b2d3fc287be0 at /dev/vda
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.utils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f4fc3-bdc3-4ccc-8cf9-c0b543b72ff1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f579ef-d515-4452-aab9-cc7be2e14978]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab026f-82cb-4961-b058-0d6d0593f455]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5de688-4c4d-4184-acab-eb4222c94920]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:12:38 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2206b83e-3df1-43ca-af40-3bd54d7d54ad]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.utils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating existing volume attachment record: b72222d3-8ec1-4128-b7f5-1c2312864297 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:38 user nova-compute[72178]: INFO nova.compute.manager [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attaching volume bcf7a021-79c4-41e1-a898-e4944a31ec3a to /dev/vdb
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.utils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dd6dfa-9d2b-4d90-954d-cfdc8eeb6c40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[43507ef6-ca29-44b4-bf8e-f69c8b7bbcf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[681a4941-1b37-4458-a655-b3cf4575755a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a512b93-1af8-42f8-9340-f1b9f974041b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:12:38 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a4b2f-9986-4707-aada-f2cb459f1758]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG os_brick.utils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating existing volume attachment record: 83c0d2f8-220c-4c4a-8cfd-3902d646c586 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-9f686bb4-0ca5-49c7-ad0e-99e5ec5416f7 req-544cf16d-5590-44d8-9021-00fcccdc644a service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9f686bb4-0ca5-49c7-ad0e-99e5ec5416f7 req-544cf16d-5590-44d8-9021-00fcccdc644a service nova] Acquiring lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9f686bb4-0ca5-49c7-ad0e-99e5ec5416f7 req-544cf16d-5590-44d8-9021-00fcccdc644a service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9f686bb4-0ca5-49c7-ad0e-99e5ec5416f7 req-544cf16d-5590-44d8-9021-00fcccdc644a service nova] Lock "45795fb0-12dd-4acc-990c-d1192e1ab54b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-9f686bb4-0ca5-49c7-ad0e-99e5ec5416f7 req-544cf16d-5590-44d8-9021-00fcccdc644a service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] No waiting events found dispatching network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:38 user nova-compute[72178]: WARNING nova.compute.manager [req-9f686bb4-0ca5-49c7-ad0e-99e5ec5416f7 req-544cf16d-5590-44d8-9021-00fcccdc644a service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received unexpected event network-vif-plugged-56751746-774a-4955-a547-c09eff25e5b5 for instance with vm_state deleted and task_state None.
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-9f686bb4-0ca5-49c7-ad0e-99e5ec5416f7 req-544cf16d-5590-44d8-9021-00fcccdc644a service nova] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Received event network-vif-deleted-56751746-774a-4955-a547-c09eff25e5b5 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-e4dac2a2-8ffe-4fad-8cad-24db4124851f req-0dd1ba63-6e05-4289-8b03-924cacb9cda1 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received event network-changed-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-e4dac2a2-8ffe-4fad-8cad-24db4124851f req-0dd1ba63-6e05-4289-8b03-924cacb9cda1 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Refreshing instance network info cache due to event network-changed-55817a06-eb38-4811-a4d8-41aeab256257. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e4dac2a2-8ffe-4fad-8cad-24db4124851f req-0dd1ba63-6e05-4289-8b03-924cacb9cda1 service nova] Acquiring lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e4dac2a2-8ffe-4fad-8cad-24db4124851f req-0dd1ba63-6e05-4289-8b03-924cacb9cda1 service nova] Acquired lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-e4dac2a2-8ffe-4fad-8cad-24db4124851f req-0dd1ba63-6e05-4289-8b03-924cacb9cda1 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Refreshing network info cache for port 55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG nova.network.neutron [req-e4dac2a2-8ffe-4fad-8cad-24db4124851f req-0dd1ba63-6e05-4289-8b03-924cacb9cda1 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Updated VIF entry in instance network info cache for port 55817a06-eb38-4811-a4d8-41aeab256257. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG nova.network.neutron [req-e4dac2a2-8ffe-4fad-8cad-24db4124851f req-0dd1ba63-6e05-4289-8b03-924cacb9cda1 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Updating instance_info_cache with network_info: [{"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e4dac2a2-8ffe-4fad-8cad-24db4124851f req-0dd1ba63-6e05-4289-8b03-924cacb9cda1 service nova] Releasing lock "refresh_cache-be40c1ae-0b3e-43c6-804b-ce8158b49233" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:43 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:43 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7069MB free_disk=25.04238510131836GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e7e1d3fe-99fe-41fe-bff7-5ea191c529de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 776b71c1-6696-4575-9c0d-e9340af62167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance febae49f-2d0b-4f28-a695-0ecaaf120077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance be40c1ae-0b3e-43c6-804b-ce8158b49233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d6ab7d82-da92-460f-9172-b635d396513e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 48f2834c-c573-46cd-98ec-d5d90e721c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance c2b7b3b8-1ed3-4754-9699-16839c7394c7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.objects.instance [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid be40c1ae-0b3e-43c6-804b-ce8158b49233 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:43 user nova-compute[72178]: INFO nova.compute.manager [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Attaching volume 514b0098-ca04-4346-9ccf-086d8e5f23b2 to /dev/vdb
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG os_brick.utils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd605ce1-031a-46c1-bd70-0b972ba8f419]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59c8172-430a-44de-bcbc-8139129fd0ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4d8e23-328f-433f-8943-f79a159c6583]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf11a9f1-4af2-45a8-8c8e-5ad30080e414]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:12:43 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:12:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b6556-c1dc-490e-8988-4a17e23c554a]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG os_brick.utils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:12:43 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Updating existing volume attachment record: a6865cce-fe16-4d87-8717-b54ba4036c7c {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:12:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:12:45 user nova-compute[72178]: INFO nova.compute.claims [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Claim successful on node user
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:12:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.policy [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5decc5e0a6b442c8ae65673dc854985', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aad2b5a65c4d8b8cdacafe727db4e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:12:45 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Creating image(s)
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "/opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "/opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Successfully created port: 4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbYTnMQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:12:46 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:12:46 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:12:46 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2252b7-4430-4c61-93f1-2c5e75763e4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:12:46 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a038d1b-ff4e-4e9e-baa2-de3e9cc5a6f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a] added
Aug 01 12:12:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7.part --force-share --output=json" returned: 0 in 0.212s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG nova.virt.images [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] 566363a5-aae5-423c-90bd-818acdb0ba60 was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7.part /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3391a6-5ce1-49f2-ba62-3d79e743d70c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9954ad1a-668d-40ac-871c-1eb2ea74528c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbYTnMQu {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbYTnMQu" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[102c4eb8-5434-459f-84af-22062a373a5a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mbYTnMQu'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2c0c7f-339a-47b8-96bc-36f1d6322b40]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f64f03-ec8c-4bdf-8af4-c3de8a85bb56]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:46 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:46 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:46 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:12:46 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:46 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:46 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:46 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:46 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae66c5a-f23f-4209-86c9-5a8d198ed45a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a, portal: 172.16.0.220,3260]
Aug 01 12:12:47 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a, portal: 172.16.0.220,3260] successful.
Aug 01 12:12:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3e6256-fd5a-4211-a42b-6e571d007c9b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cbbc1e-5c5d-47a3-9f99-1ea171d70f22]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:47 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:47 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:47 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:47 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:47 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:47 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:47 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:47 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc7c346-e910-4811-a916-a0e40923ff9f]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbYTnMQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7.part /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7.converted" returned: 0 in 0.481s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.633s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Successfully updated port: 4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquired lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-12af7629-03d8-46a7-8240-b7fca858c8ad req-cfdc0785-598a-4d02-97f0-63ab64f7ee55 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-12af7629-03d8-46a7-8240-b7fca858c8ad req-cfdc0785-598a-4d02-97f0-63ab64f7ee55 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing instance network info cache due to event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-12af7629-03d8-46a7-8240-b7fca858c8ad req-cfdc0785-598a-4d02-97f0-63ab64f7ee55 service nova] Acquiring lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7 --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7 --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7,backing_fmt=raw /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7,backing_fmt=raw /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk 1073741824" returned: 0 in 0.188s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7 --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23639366332643361', 'path': '/dev/sdf'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639366332643361', 'path': '/dev/sdf'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Cannot resize image /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'migration_context' on Instance uuid c4621d07-791b-49da-97b3-aa8558914e7b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Ensure instance console log exists: /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Releasing lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Instance network_info: |[{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-12af7629-03d8-46a7-8240-b7fca858c8ad req-cfdc0785-598a-4d02-97f0-63ab64f7ee55 service nova] Acquired lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-12af7629-03d8-46a7-8240-b7fca858c8ad req-cfdc0785-598a-4d02-97f0-63ab64f7ee55 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Start _get_guest_xml network_info=[{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T12:12:42Z,direct_url=<?>,disk_format='qcow2',id=566363a5-aae5-423c-90bd-818acdb0ba60,min_disk=0,min_ram=0,name='tempest-scenario-img--1681228850',owner='c9aad2b5a65c4d8b8cdacafe727db4e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T12:12:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '566363a5-aae5-423c-90bd-818acdb0ba60'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:12:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:12:48 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:12:48 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:12:48 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:12:48 user nova-compute[72178]:   <serial>bcf7a021-79c4-41e1-a898-e4944a31ec3a</serial>
Aug 01 12:12:48 user nova-compute[72178]: </disk>
Aug 01 12:12:48 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T12:12:42Z,direct_url=<?>,disk_format='qcow2',id=566363a5-aae5-423c-90bd-818acdb0ba60,min_disk=0,min_ram=0,name='tempest-scenario-img--1681228850',owner='c9aad2b5a65c4d8b8cdacafe727db4e3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T12:12:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596342614',display_name='tempest-TestMinimumBasicScenario-server-1596342614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596342614',id=33,image_ref='566363a5-aae5-423c-90bd-818acdb0ba60',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq6dGsc8YTSokjQNBcdV2EswuFBDTwAaZU1yqcCT9xbGBTFZmiIb0uMthO9tIWuyq0AFUUgX9w43SsAxeRTwtti98fxbXtEmiibpUJrVuPjoAY7qAryoAfikZqg7TPODg==',key_name='tempest-TestMinimumBasicScenario-1623450736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-9wzta6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='566363a5-aae5-423c-90bd-818acdb0ba60',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:12:46Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=c4621d07-791b-49da-97b3-aa8558914e7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b7:43,bridge_name='br-int',has_traffic_filtering=True,id=4d0afb8c-1700-4680-b0cf-4f19ce23d15e,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0afb8c-17') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'pci_devices' on Instance uuid c4621d07-791b-49da-97b3-aa8558914e7b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:12:48 user nova-compute[72178]:   <uuid>c4621d07-791b-49da-97b3-aa8558914e7b</uuid>
Aug 01 12:12:48 user nova-compute[72178]:   <name>instance-00000021</name>
Aug 01 12:12:48 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:12:48 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:12:48 user nova-compute[72178]:   <metadata>
Aug 01 12:12:48 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:12:48 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:12:48 user nova-compute[72178]:       <nova:name>tempest-TestMinimumBasicScenario-server-1596342614</nova:name>
Aug 01 12:12:48 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:12:48</nova:creationTime>
Aug 01 12:12:48 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:12:48 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:12:48 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:12:48 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:12:48 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:12:48 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:12:48 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:12:48 user nova-compute[72178]:       <nova:owner>
Aug 01 12:12:48 user nova-compute[72178]:         <nova:user uuid="a5decc5e0a6b442c8ae65673dc854985">tempest-TestMinimumBasicScenario-1575364257-project-member</nova:user>
Aug 01 12:12:48 user nova-compute[72178]:         <nova:project uuid="c9aad2b5a65c4d8b8cdacafe727db4e3">tempest-TestMinimumBasicScenario-1575364257</nova:project>
Aug 01 12:12:48 user nova-compute[72178]:       </nova:owner>
Aug 01 12:12:48 user nova-compute[72178]:       <nova:root type="image" uuid="566363a5-aae5-423c-90bd-818acdb0ba60"/>
Aug 01 12:12:48 user nova-compute[72178]:       <nova:ports>
Aug 01 12:12:48 user nova-compute[72178]:         <nova:port uuid="4d0afb8c-1700-4680-b0cf-4f19ce23d15e">
Aug 01 12:12:48 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 12:12:48 user nova-compute[72178]:         </nova:port>
Aug 01 12:12:48 user nova-compute[72178]:       </nova:ports>
Aug 01 12:12:48 user nova-compute[72178]:     </nova:instance>
Aug 01 12:12:48 user nova-compute[72178]:   </metadata>
Aug 01 12:12:48 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:12:48 user nova-compute[72178]:     <system>
Aug 01 12:12:48 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:12:48 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:12:48 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:12:48 user nova-compute[72178]:       <entry name="serial">c4621d07-791b-49da-97b3-aa8558914e7b</entry>
Aug 01 12:12:48 user nova-compute[72178]:       <entry name="uuid">c4621d07-791b-49da-97b3-aa8558914e7b</entry>
Aug 01 12:12:48 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:12:48 user nova-compute[72178]:     </system>
Aug 01 12:12:48 user nova-compute[72178]:   </sysinfo>
Aug 01 12:12:48 user nova-compute[72178]:   <os>
Aug 01 12:12:48 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:12:48 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:12:48 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:12:48 user nova-compute[72178]:   </os>
Aug 01 12:12:48 user nova-compute[72178]:   <features>
Aug 01 12:12:48 user nova-compute[72178]:     <acpi/>
Aug 01 12:12:48 user nova-compute[72178]:     <apic/>
Aug 01 12:12:48 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:12:48 user nova-compute[72178]:   </features>
Aug 01 12:12:48 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:12:48 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:12:48 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:12:48 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:12:48 user nova-compute[72178]:   </clock>
Aug 01 12:12:48 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:12:48 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:12:48 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:12:48 user nova-compute[72178]:   </cpu>
Aug 01 12:12:48 user nova-compute[72178]:   <devices>
Aug 01 12:12:48 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:12:48 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:12:48 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk"/>
Aug 01 12:12:48 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:12:48 user nova-compute[72178]:     </disk>
Aug 01 12:12:48 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:12:48 user nova-compute[72178]:       <mac address="fa:16:3e:1c:b7:43"/>
Aug 01 12:12:48 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:12:48 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:12:48 user nova-compute[72178]:       <target dev="tap4d0afb8c-17"/>
Aug 01 12:12:48 user nova-compute[72178]:     </interface>
Aug 01 12:12:48 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:12:48 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/console.log" append="off"/>
Aug 01 12:12:48 user nova-compute[72178]:     </serial>
Aug 01 12:12:48 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:12:48 user nova-compute[72178]:     <video>
Aug 01 12:12:48 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:12:48 user nova-compute[72178]:     </video>
Aug 01 12:12:48 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:12:48 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:12:48 user nova-compute[72178]:     </rng>
Aug 01 12:12:48 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:12:48 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:12:48 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:12:48 user nova-compute[72178]:     </memballoon>
Aug 01 12:12:48 user nova-compute[72178]:   </devices>
Aug 01 12:12:48 user nova-compute[72178]: </domain>
Aug 01 12:12:48 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596342614',display_name='tempest-TestMinimumBasicScenario-server-1596342614',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596342614',id=33,image_ref='566363a5-aae5-423c-90bd-818acdb0ba60',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq6dGsc8YTSokjQNBcdV2EswuFBDTwAaZU1yqcCT9xbGBTFZmiIb0uMthO9tIWuyq0AFUUgX9w43SsAxeRTwtti98fxbXtEmiibpUJrVuPjoAY7qAryoAfikZqg7TPODg==',key_name='tempest-TestMinimumBasicScenario-1623450736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-9wzta6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='566363a5-aae5-423c-90bd-818acdb0ba60',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:12:46Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=c4621d07-791b-49da-97b3-aa8558914e7b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b7:43,bridge_name='br-int',has_traffic_filtering=True,id=4d0afb8c-1700-4680-b0cf-4f19ce23d15e,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0afb8c-17') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG os_vif [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b7:43,bridge_name='br-int',has_traffic_filtering=True,id=4d0afb8c-1700-4680-b0cf-4f19ce23d15e,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0afb8c-17') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d0afb8c-17, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d0afb8c-17, col_values=(('external_ids', {'iface-id': '4d0afb8c-1700-4680-b0cf-4f19ce23d15e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:b7:43', 'vm-uuid': 'c4621d07-791b-49da-97b3-aa8558914e7b'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:48 user nova-compute[72178]: INFO os_vif [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b7:43,bridge_name='br-int',has_traffic_filtering=True,id=4d0afb8c-1700-4680-b0cf-4f19ce23d15e,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0afb8c-17')
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No VIF found with MAC fa:16:3e:1c:b7:43, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-12af7629-03d8-46a7-8240-b7fca858c8ad req-cfdc0785-598a-4d02-97f0-63ab64f7ee55 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updated VIF entry in instance network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-12af7629-03d8-46a7-8240-b7fca858c8ad req-cfdc0785-598a-4d02-97f0-63ab64f7ee55 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-12af7629-03d8-46a7-8240-b7fca858c8ad req-cfdc0785-598a-4d02-97f0-63ab64f7ee55 service nova] Releasing lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No VIF found with MAC fa:16:3e:d2:93:c8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:12:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-f1507c94-e341-43d5-b687-a736d4d9c97a tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.666s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690891955.0054502, 45795fb0-12dd-4acc-990c-d1192e1ab54b => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:50 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] VM Stopped (Lifecycle Event)
Aug 01 12:12:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6874d400-1541-4804-a924-ee49115ba870 None None] [instance: 45795fb0-12dd-4acc-990c-d1192e1ab54b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-938c8977-057f-4eb7-9303-9d24bbd52c5d req-6f0f966e-939d-4d69-84c5-0e3456fa281c service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-938c8977-057f-4eb7-9303-9d24bbd52c5d req-6f0f966e-939d-4d69-84c5-0e3456fa281c service nova] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-938c8977-057f-4eb7-9303-9d24bbd52c5d req-6f0f966e-939d-4d69-84c5-0e3456fa281c service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-938c8977-057f-4eb7-9303-9d24bbd52c5d req-6f0f966e-939d-4d69-84c5-0e3456fa281c service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-938c8977-057f-4eb7-9303-9d24bbd52c5d req-6f0f966e-939d-4d69-84c5-0e3456fa281c service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] No waiting events found dispatching network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:50 user nova-compute[72178]: WARNING nova.compute.manager [req-938c8977-057f-4eb7-9303-9d24bbd52c5d req-6f0f966e-939d-4d69-84c5-0e3456fa281c service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received unexpected event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e for instance with vm_state building and task_state spawning.
Aug 01 12:12:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891972.2675316, c4621d07-791b-49da-97b3-aa8558914e7b => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:52 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] VM Resumed (Lifecycle Event)
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:12:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Instance spawned successfully.
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:12:52 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891972.2687874, c4621d07-791b-49da-97b3-aa8558914e7b => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:12:52 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] VM Started (Lifecycle Event)
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:12:52 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:12:52 user nova-compute[72178]: INFO nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Took 6.52 seconds to spawn the instance on the hypervisor.
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-24a20044-9a99-43de-becd-0fcb5574ca17 req-4f27d295-94a4-4457-8b7f-d165463d5375 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-24a20044-9a99-43de-becd-0fcb5574ca17 req-4f27d295-94a4-4457-8b7f-d165463d5375 service nova] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-24a20044-9a99-43de-becd-0fcb5574ca17 req-4f27d295-94a4-4457-8b7f-d165463d5375 service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-24a20044-9a99-43de-becd-0fcb5574ca17 req-4f27d295-94a4-4457-8b7f-d165463d5375 service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-24a20044-9a99-43de-becd-0fcb5574ca17 req-4f27d295-94a4-4457-8b7f-d165463d5375 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] No waiting events found dispatching network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:12:52 user nova-compute[72178]: WARNING nova.compute.manager [req-24a20044-9a99-43de-becd-0fcb5574ca17 req-4f27d295-94a4-4457-8b7f-d165463d5375 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received unexpected event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e for instance with vm_state building and task_state spawning.
Aug 01 12:12:52 user nova-compute[72178]: INFO nova.compute.manager [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Took 7.35 seconds to build instance.
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0a210d50-0b76-4cf1-9edb-028be8873129 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.470s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Mgjwturp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:12:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:12:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:12:52 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e59e9e-6ce3-4579-95a2-8db8838e77fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:12:52 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec00672-8313-4714-9496-4041a2d8d447]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2] added
Aug 01 12:12:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[07989e75-1ec5-4784-8fd0-3e869324ec55]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded2c6a1-6bd9-489f-85df-8b4f1a3796f9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Mgjwturp {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Mgjwturp" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e779b4-f4e7-4999-b7cd-6544228778fd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Mgjwturp'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14f96ed-e10d-4979-a68f-939898c73043]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b49dcd-e003-4055-bde4-8ce872520a5d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:52 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:52 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:52 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:52 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:52 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:52 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:52 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:52 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc2bdce-7902-4a23-957d-a23c3f5ad1a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2, portal: 172.16.0.220,3260]
Aug 01 12:12:52 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2, portal: 172.16.0.220,3260] successful.
Aug 01 12:12:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.098s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7589ef92-2f39-482d-90bd-066eaa590dee]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0db9491-2479-4942-9ce9-e8995d7b3a4e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:12:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:53 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:12:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3281cb90-4679-4aad-aa95-3793f9717b6d]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lazy-loading 'pci_requests' on Instance uuid c2b7b3b8-1ed3-4754-9699-16839c7394c7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lazy-loading 'numa_topology' on Instance uuid c2b7b3b8-1ed3-4754-9699-16839c7394c7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:12:53 user nova-compute[72178]: INFO nova.compute.claims [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Claim successful on node user
Aug 01 12:12:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:12:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:53 user nova-compute[72178]: INFO nova.network.neutron [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Mgjwturp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '26335313266396365', 'path': '/dev/sdg'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335313266396365', 'path': '/dev/sdg'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid be40c1ae-0b3e-43c6-804b-ce8158b49233 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:12:54 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:12:54 user nova-compute[72178]:   <source dev="/dev/sdg"/>
Aug 01 12:12:54 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:12:54 user nova-compute[72178]:   <serial>514b0098-ca04-4346-9ccf-086d8e5f23b2</serial>
Aug 01 12:12:54 user nova-compute[72178]: </disk>
Aug 01 12:12:54 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No VIF found with MAC fa:16:3e:6b:33:8a, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:12:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-67170c9b-5a2e-4631-abf8-3cd82dd07698 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.021s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec95eebd-0840-4eeb-a88e-6d1ac23072f2 req-ed55c0d4-e8ac-4205-a334-95d7f04c1005 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received event network-changed-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-ec95eebd-0840-4eeb-a88e-6d1ac23072f2 req-ed55c0d4-e8ac-4205-a334-95d7f04c1005 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Refreshing instance network info cache due to event network-changed-a424854f-d402-47c0-952b-f405b7e31c4e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:12:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec95eebd-0840-4eeb-a88e-6d1ac23072f2 req-ed55c0d4-e8ac-4205-a334-95d7f04c1005 service nova] Acquiring lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec95eebd-0840-4eeb-a88e-6d1ac23072f2 req-ed55c0d4-e8ac-4205-a334-95d7f04c1005 service nova] Acquired lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:55 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec95eebd-0840-4eeb-a88e-6d1ac23072f2 req-ed55c0d4-e8ac-4205-a334-95d7f04c1005 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Refreshing network info cache for port a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:12:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquired lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec95eebd-0840-4eeb-a88e-6d1ac23072f2 req-ed55c0d4-e8ac-4205-a334-95d7f04c1005 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Updated VIF entry in instance network info cache for port a424854f-d402-47c0-952b-f405b7e31c4e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.network.neutron [req-ec95eebd-0840-4eeb-a88e-6d1ac23072f2 req-ed55c0d4-e8ac-4205-a334-95d7f04c1005 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Updating instance_info_cache with network_info: [{"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ec95eebd-0840-4eeb-a88e-6d1ac23072f2 req-ed55c0d4-e8ac-4205-a334-95d7f04c1005 service nova] Releasing lock "refresh_cache-d6ab7d82-da92-460f-9172-b635d396513e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Releasing lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:12:56 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Creating image(s)
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Ensure instance console log exists: /opt/stack/data/nova/instances/c2b7b3b8-1ed3-4754-9699-16839c7394c7/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Start _get_guest_xml network_info=[{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUfTGMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2b7b3b8-1ed3-4754-9699-16839c7394c7', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa4dbd87-fe59-416b-ac59-b2d3fc287be0', 'serial': 'fa4dbd87-fe59-416b-ac59-b2d3fc287be0'}, 'boot_index': 0, 'attachment_id': 'b72222d3-8ec1-4128-b7f5-1c2312864297', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:12:56 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:56 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:12:56 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lazy-loading 'vcpu_model' on Instance uuid c2b7b3b8-1ed3-4754-9699-16839c7394c7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUfTGMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:12:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:12:57 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:12:57 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1603d18-014e-4854-8cf1-2d99f74d8fc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:12:57 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f824df8d-55ee-46a7-a325-6f4499cbabf5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0] added
Aug 01 12:12:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[05de8de4-88cc-4aaf-abdd-5f59e8a6dde0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c5fd5c-5d46-4c35-a589-7041af0c90ad]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUfTGMXR {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUfTGMXR" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23c4608-1aa5-4372-a468-1910f6d7d72b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUfTGMXR'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d673567a-e7c7-431a-ad63-dd243378d4dd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57cf9f5-5605-4908-a44e-f8ec0ce1590a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e8ab39-4940-4a7b-b034-88c3b4700673]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260]
Aug 01 12:12:57 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260] successful.
Aug 01 12:12:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c1b65e-7d52-4eff-80b1-7c3c58dc93e1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f6d15-2471-4805-b151-e66cb93bff10]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:12:57 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[41482610-96b6-44f2-8747-b562e9cdf0ad]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUfTGMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-a152a83c-69a4-4a90-8606-bdc81bb3d08b req-213156da-33de-415c-87e1-7fe5a8c04abe service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-a152a83c-69a4-4a90-8606-bdc81bb3d08b req-213156da-33de-415c-87e1-7fe5a8c04abe service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing instance network info cache due to event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a152a83c-69a4-4a90-8606-bdc81bb3d08b req-213156da-33de-415c-87e1-7fe5a8c04abe service nova] Acquiring lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a152a83c-69a4-4a90-8606-bdc81bb3d08b req-213156da-33de-415c-87e1-7fe5a8c04abe service nova] Acquired lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-a152a83c-69a4-4a90-8606-bdc81bb3d08b req-213156da-33de-415c-87e1-7fe5a8c04abe service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:12:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-a152a83c-69a4-4a90-8606-bdc81bb3d08b req-213156da-33de-415c-87e1-7fe5a8c04abe service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updated VIF entry in instance network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-a152a83c-69a4-4a90-8606-bdc81bb3d08b req-213156da-33de-415c-87e1-7fe5a8c04abe service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a152a83c-69a4-4a90-8606-bdc81bb3d08b req-213156da-33de-415c-87e1-7fe5a8c04abe service nova] Releasing lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23038653137393539', 'path': '/dev/sdh'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038653137393539', 'path': '/dev/sdh'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1328072652',display_name='tempest-TestShelveInstance-server-1328072652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1328072652',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-619818221',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:09:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='729b625630fd4a26ba76891d65a5f5bc',ramdisk_id='',reservation_id='r-2737bifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-297202234',owner_user_name='tempest-TestShelveInstance-297202234-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:12:38Z,user_data=None,user_id='192962f272724516b92bb7c10add101b',uuid=c2b7b3b8-1ed3-4754-9699-16839c7394c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converting VIF {"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lazy-loading 'pci_devices' on Instance uuid c2b7b3b8-1ed3-4754-9699-16839c7394c7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:12:58 user nova-compute[72178]:   <uuid>c2b7b3b8-1ed3-4754-9699-16839c7394c7</uuid>
Aug 01 12:12:58 user nova-compute[72178]:   <name>instance-0000001b</name>
Aug 01 12:12:58 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:12:58 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:12:58 user nova-compute[72178]:   <metadata>
Aug 01 12:12:58 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:12:58 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:12:58 user nova-compute[72178]:       <nova:name>tempest-TestShelveInstance-server-1328072652</nova:name>
Aug 01 12:12:58 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:12:56</nova:creationTime>
Aug 01 12:12:58 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:12:58 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:12:58 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:12:58 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:12:58 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:12:58 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:12:58 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:12:58 user nova-compute[72178]:       <nova:owner>
Aug 01 12:12:58 user nova-compute[72178]:         <nova:user uuid="192962f272724516b92bb7c10add101b">tempest-TestShelveInstance-297202234-project-member</nova:user>
Aug 01 12:12:58 user nova-compute[72178]:         <nova:project uuid="729b625630fd4a26ba76891d65a5f5bc">tempest-TestShelveInstance-297202234</nova:project>
Aug 01 12:12:58 user nova-compute[72178]:       </nova:owner>
Aug 01 12:12:58 user nova-compute[72178]:       <nova:ports>
Aug 01 12:12:58 user nova-compute[72178]:         <nova:port uuid="ee85ca88-4f2e-40c5-aca3-d3114cd5c03a">
Aug 01 12:12:58 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 12:12:58 user nova-compute[72178]:         </nova:port>
Aug 01 12:12:58 user nova-compute[72178]:       </nova:ports>
Aug 01 12:12:58 user nova-compute[72178]:     </nova:instance>
Aug 01 12:12:58 user nova-compute[72178]:   </metadata>
Aug 01 12:12:58 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:12:58 user nova-compute[72178]:     <system>
Aug 01 12:12:58 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:12:58 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:12:58 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:12:58 user nova-compute[72178]:       <entry name="serial">c2b7b3b8-1ed3-4754-9699-16839c7394c7</entry>
Aug 01 12:12:58 user nova-compute[72178]:       <entry name="uuid">c2b7b3b8-1ed3-4754-9699-16839c7394c7</entry>
Aug 01 12:12:58 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:12:58 user nova-compute[72178]:     </system>
Aug 01 12:12:58 user nova-compute[72178]:   </sysinfo>
Aug 01 12:12:58 user nova-compute[72178]:   <os>
Aug 01 12:12:58 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:12:58 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:12:58 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:12:58 user nova-compute[72178]:   </os>
Aug 01 12:12:58 user nova-compute[72178]:   <features>
Aug 01 12:12:58 user nova-compute[72178]:     <acpi/>
Aug 01 12:12:58 user nova-compute[72178]:     <apic/>
Aug 01 12:12:58 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:12:58 user nova-compute[72178]:   </features>
Aug 01 12:12:58 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:12:58 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:12:58 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:12:58 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:12:58 user nova-compute[72178]:   </clock>
Aug 01 12:12:58 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:12:58 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:12:58 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:12:58 user nova-compute[72178]:   </cpu>
Aug 01 12:12:58 user nova-compute[72178]:   <devices>
Aug 01 12:12:58 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:12:58 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:12:58 user nova-compute[72178]:       <source dev="/dev/sdh"/>
Aug 01 12:12:58 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:12:58 user nova-compute[72178]:       <serial>fa4dbd87-fe59-416b-ac59-b2d3fc287be0</serial>
Aug 01 12:12:58 user nova-compute[72178]:     </disk>
Aug 01 12:12:58 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:12:58 user nova-compute[72178]:       <mac address="fa:16:3e:dc:63:db"/>
Aug 01 12:12:58 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:12:58 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:12:58 user nova-compute[72178]:       <target dev="tapee85ca88-4f"/>
Aug 01 12:12:58 user nova-compute[72178]:     </interface>
Aug 01 12:12:58 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:12:58 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/c2b7b3b8-1ed3-4754-9699-16839c7394c7/console.log" append="off"/>
Aug 01 12:12:58 user nova-compute[72178]:     </serial>
Aug 01 12:12:58 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:12:58 user nova-compute[72178]:     <video>
Aug 01 12:12:58 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:12:58 user nova-compute[72178]:     </video>
Aug 01 12:12:58 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:12:58 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:12:58 user nova-compute[72178]:     </rng>
Aug 01 12:12:58 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:12:58 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:12:58 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:12:58 user nova-compute[72178]:     </memballoon>
Aug 01 12:12:58 user nova-compute[72178]:   </devices>
Aug 01 12:12:58 user nova-compute[72178]: </domain>
Aug 01 12:12:58 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1328072652',display_name='tempest-TestShelveInstance-server-1328072652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1328072652',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-619818221',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:09:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='729b625630fd4a26ba76891d65a5f5bc',ramdisk_id='',reservation_id='r-2737bifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-297202234',owner_user_name='tempest-TestShelveInstance-297202234-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:12:38Z,user_data=None,user_id='192962f272724516b92bb7c10add101b',uuid=c2b7b3b8-1ed3-4754-9699-16839c7394c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converting VIF {"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG os_vif [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee85ca88-4f, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee85ca88-4f, col_values=(('external_ids', {'iface-id': 'ee85ca88-4f2e-40c5-aca3-d3114cd5c03a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:63:db', 'vm-uuid': 'c2b7b3b8-1ed3-4754-9699-16839c7394c7'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:12:58 user nova-compute[72178]: INFO os_vif [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f')
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:12:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] No VIF found with MAC fa:16:3e:dc:63:db, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:12:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "8567b676-68ad-4869-8c32-babff84c347b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "8567b676-68ad-4869-8c32-babff84c347b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:12:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:12:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:12:59 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:12:59 user nova-compute[72178]: INFO nova.compute.claims [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Claim successful on node user
Aug 01 12:12:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-10e13dc8-0a77-488e-83fa-b60727babb1d req-3a9207f7-7e4a-46a8-b75f-2102f6d08a2d service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10e13dc8-0a77-488e-83fa-b60727babb1d req-3a9207f7-7e4a-46a8-b75f-2102f6d08a2d service nova] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10e13dc8-0a77-488e-83fa-b60727babb1d req-3a9207f7-7e4a-46a8-b75f-2102f6d08a2d service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-10e13dc8-0a77-488e-83fa-b60727babb1d req-3a9207f7-7e4a-46a8-b75f-2102f6d08a2d service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-10e13dc8-0a77-488e-83fa-b60727babb1d req-3a9207f7-7e4a-46a8-b75f-2102f6d08a2d service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] No waiting events found dispatching network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:00 user nova-compute[72178]: WARNING nova.compute.manager [req-10e13dc8-0a77-488e-83fa-b60727babb1d req-3a9207f7-7e4a-46a8-b75f-2102f6d08a2d service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received unexpected event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.network.neutron [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:13:00 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:13:00 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Creating image(s)
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "/opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "/opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "/opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.180s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.240s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG nova.policy [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd81d3a10a4819a414d5a61a9d6056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874d88ce21b743e195c696aaa7195ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk 1073741824" returned: 0 in 0.073s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.192s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Cannot resize image /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG nova.objects.instance [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'migration_context' on Instance uuid 8567b676-68ad-4869-8c32-babff84c347b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Ensure instance console log exists: /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-fd994398-e65f-4485-9712-534e222275ea req-d5c18d59-058f-4ab2-9498-1f054d91a509 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd994398-e65f-4485-9712-534e222275ea req-d5c18d59-058f-4ab2-9498-1f054d91a509 service nova] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd994398-e65f-4485-9712-534e222275ea req-d5c18d59-058f-4ab2-9498-1f054d91a509 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fd994398-e65f-4485-9712-534e222275ea req-d5c18d59-058f-4ab2-9498-1f054d91a509 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-fd994398-e65f-4485-9712-534e222275ea req-d5c18d59-058f-4ab2-9498-1f054d91a509 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] No waiting events found dispatching network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:02 user nova-compute[72178]: WARNING nova.compute.manager [req-fd994398-e65f-4485-9712-534e222275ea req-d5c18d59-058f-4ab2-9498-1f054d91a509 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received unexpected event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a for instance with vm_state shelved_offloaded and task_state spawning.
Aug 01 12:13:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891983.0265865, c2b7b3b8-1ed3-4754-9699-16839c7394c7 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:03 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] VM Resumed (Lifecycle Event)
Aug 01 12:13:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance spawned successfully.
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.network.neutron [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Successfully created port: c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:13:03 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891983.0283682, c2b7b3b8-1ed3-4754-9699-16839c7394c7 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:03 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] VM Started (Lifecycle Event)
Aug 01 12:13:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b59e32da-fc25-49c4-aa57-46c62c20113e tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.138s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:13:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:04 user nova-compute[72178]: DEBUG nova.network.neutron [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Successfully updated port: c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:13:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:13:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquired lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:13:04 user nova-compute[72178]: DEBUG nova.network.neutron [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:13:04 user nova-compute[72178]: DEBUG nova.network.neutron [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-557c1d03-8316-47c0-8d21-589fd1081f55 req-7c87cbb7-b0b9-4f6b-8aaf-2eefa2450094 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-changed-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.compute.manager [req-557c1d03-8316-47c0-8d21-589fd1081f55 req-7c87cbb7-b0b9-4f6b-8aaf-2eefa2450094 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Refreshing instance network info cache due to event network-changed-c58015ad-87f2-4b34-8754-b64d3e65440c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-557c1d03-8316-47c0-8d21-589fd1081f55 req-7c87cbb7-b0b9-4f6b-8aaf-2eefa2450094 service nova] Acquiring lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.network.neutron [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Updating instance_info_cache with network_info: [{"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Releasing lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Instance network_info: |[{"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-557c1d03-8316-47c0-8d21-589fd1081f55 req-7c87cbb7-b0b9-4f6b-8aaf-2eefa2450094 service nova] Acquired lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.network.neutron [req-557c1d03-8316-47c0-8d21-589fd1081f55 req-7c87cbb7-b0b9-4f6b-8aaf-2eefa2450094 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Refreshing network info cache for port c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Start _get_guest_xml network_info=[{"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:13:05 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:13:05 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1990855850',display_name='tempest-AttachVolumeNegativeTest-server-1990855850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1990855850',id=34,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoWNMHX8ToTiy7Wd04Vb5j2AWL0SQzjgWvp41dU7EyiLU9MGjgLXlSugJ1Hgi57p/GEX99sndiHgaZoPNqrXbKo15ZDj8l4ZkvBGZi9NBISz9DqoYuZP3R/n9MC2OKrSA==',key_name='tempest-keypair-1450729308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-i0jcsu45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=8567b676-68ad-4869-8c32-babff84c347b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:14,bridge_name='br-int',has_traffic_filtering=True,id=c58015ad-87f2-4b34-8754-b64d3e65440c,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58015ad-87') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.objects.instance [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'pci_devices' on Instance uuid 8567b676-68ad-4869-8c32-babff84c347b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:13:05 user nova-compute[72178]:   <uuid>8567b676-68ad-4869-8c32-babff84c347b</uuid>
Aug 01 12:13:05 user nova-compute[72178]:   <name>instance-00000022</name>
Aug 01 12:13:05 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:13:05 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:13:05 user nova-compute[72178]:   <metadata>
Aug 01 12:13:05 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:13:05 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:13:05 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1990855850</nova:name>
Aug 01 12:13:05 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:13:05</nova:creationTime>
Aug 01 12:13:05 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:13:05 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:13:05 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:13:05 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:13:05 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:13:05 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:13:05 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:13:05 user nova-compute[72178]:       <nova:owner>
Aug 01 12:13:05 user nova-compute[72178]:         <nova:user uuid="73fd81d3a10a4819a414d5a61a9d6056">tempest-AttachVolumeNegativeTest-1677263646-project-member</nova:user>
Aug 01 12:13:05 user nova-compute[72178]:         <nova:project uuid="874d88ce21b743e195c696aaa7195ffc">tempest-AttachVolumeNegativeTest-1677263646</nova:project>
Aug 01 12:13:05 user nova-compute[72178]:       </nova:owner>
Aug 01 12:13:05 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:13:05 user nova-compute[72178]:       <nova:ports>
Aug 01 12:13:05 user nova-compute[72178]:         <nova:port uuid="c58015ad-87f2-4b34-8754-b64d3e65440c">
Aug 01 12:13:05 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 12:13:05 user nova-compute[72178]:         </nova:port>
Aug 01 12:13:05 user nova-compute[72178]:       </nova:ports>
Aug 01 12:13:05 user nova-compute[72178]:     </nova:instance>
Aug 01 12:13:05 user nova-compute[72178]:   </metadata>
Aug 01 12:13:05 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:13:05 user nova-compute[72178]:     <system>
Aug 01 12:13:05 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:13:05 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:13:05 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:13:05 user nova-compute[72178]:       <entry name="serial">8567b676-68ad-4869-8c32-babff84c347b</entry>
Aug 01 12:13:05 user nova-compute[72178]:       <entry name="uuid">8567b676-68ad-4869-8c32-babff84c347b</entry>
Aug 01 12:13:05 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:13:05 user nova-compute[72178]:     </system>
Aug 01 12:13:05 user nova-compute[72178]:   </sysinfo>
Aug 01 12:13:05 user nova-compute[72178]:   <os>
Aug 01 12:13:05 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:13:05 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:13:05 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:13:05 user nova-compute[72178]:   </os>
Aug 01 12:13:05 user nova-compute[72178]:   <features>
Aug 01 12:13:05 user nova-compute[72178]:     <acpi/>
Aug 01 12:13:05 user nova-compute[72178]:     <apic/>
Aug 01 12:13:05 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:13:05 user nova-compute[72178]:   </features>
Aug 01 12:13:05 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:13:05 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:13:05 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:13:05 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:13:05 user nova-compute[72178]:   </clock>
Aug 01 12:13:05 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:13:05 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:13:05 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:13:05 user nova-compute[72178]:   </cpu>
Aug 01 12:13:05 user nova-compute[72178]:   <devices>
Aug 01 12:13:05 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:13:05 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:13:05 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk"/>
Aug 01 12:13:05 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:13:05 user nova-compute[72178]:     </disk>
Aug 01 12:13:05 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:13:05 user nova-compute[72178]:       <mac address="fa:16:3e:bc:6a:14"/>
Aug 01 12:13:05 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:13:05 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:13:05 user nova-compute[72178]:       <target dev="tapc58015ad-87"/>
Aug 01 12:13:05 user nova-compute[72178]:     </interface>
Aug 01 12:13:05 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:13:05 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/console.log" append="off"/>
Aug 01 12:13:05 user nova-compute[72178]:     </serial>
Aug 01 12:13:05 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:13:05 user nova-compute[72178]:     <video>
Aug 01 12:13:05 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:13:05 user nova-compute[72178]:     </video>
Aug 01 12:13:05 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:13:05 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:13:05 user nova-compute[72178]:     </rng>
Aug 01 12:13:05 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:13:05 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:13:05 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:13:05 user nova-compute[72178]:     </memballoon>
Aug 01 12:13:05 user nova-compute[72178]:   </devices>
Aug 01 12:13:05 user nova-compute[72178]: </domain>
Aug 01 12:13:05 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1990855850',display_name='tempest-AttachVolumeNegativeTest-server-1990855850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1990855850',id=34,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoWNMHX8ToTiy7Wd04Vb5j2AWL0SQzjgWvp41dU7EyiLU9MGjgLXlSugJ1Hgi57p/GEX99sndiHgaZoPNqrXbKo15ZDj8l4ZkvBGZi9NBISz9DqoYuZP3R/n9MC2OKrSA==',key_name='tempest-keypair-1450729308',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-i0jcsu45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=8567b676-68ad-4869-8c32-babff84c347b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:14,bridge_name='br-int',has_traffic_filtering=True,id=c58015ad-87f2-4b34-8754-b64d3e65440c,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58015ad-87') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG os_vif [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:14,bridge_name='br-int',has_traffic_filtering=True,id=c58015ad-87f2-4b34-8754-b64d3e65440c,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58015ad-87') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc58015ad-87, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc58015ad-87, col_values=(('external_ids', {'iface-id': 'c58015ad-87f2-4b34-8754-b64d3e65440c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:6a:14', 'vm-uuid': '8567b676-68ad-4869-8c32-babff84c347b'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:05 user nova-compute[72178]: INFO os_vif [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:14,bridge_name='br-int',has_traffic_filtering=True,id=c58015ad-87f2-4b34-8754-b64d3e65440c,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58015ad-87')
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:13:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No VIF found with MAC fa:16:3e:bc:6a:14, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG nova.network.neutron [req-557c1d03-8316-47c0-8d21-589fd1081f55 req-7c87cbb7-b0b9-4f6b-8aaf-2eefa2450094 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Updated VIF entry in instance network info cache for port c58015ad-87f2-4b34-8754-b64d3e65440c. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG nova.network.neutron [req-557c1d03-8316-47c0-8d21-589fd1081f55 req-7c87cbb7-b0b9-4f6b-8aaf-2eefa2450094 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Updating instance_info_cache with network_info: [{"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-557c1d03-8316-47c0-8d21-589fd1081f55 req-7c87cbb7-b0b9-4f6b-8aaf-2eefa2450094 service nova] Releasing lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "155adc09-065e-425b-8573-7b1be9aa030b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "155adc09-065e-425b-8573-7b1be9aa030b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:06 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:13:06 user nova-compute[72178]: INFO nova.compute.claims [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Claim successful on node user
Aug 01 12:13:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-b3b767da-2581-4c38-ba6d-28ea32a48b44 req-3a698dc3-572a-4913-b35f-7e53f317aafb service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b3b767da-2581-4c38-ba6d-28ea32a48b44 req-3a698dc3-572a-4913-b35f-7e53f317aafb service nova] Acquiring lock "8567b676-68ad-4869-8c32-babff84c347b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b3b767da-2581-4c38-ba6d-28ea32a48b44 req-3a698dc3-572a-4913-b35f-7e53f317aafb service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b3b767da-2581-4c38-ba6d-28ea32a48b44 req-3a698dc3-572a-4913-b35f-7e53f317aafb service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.compute.manager [req-b3b767da-2581-4c38-ba6d-28ea32a48b44 req-3a698dc3-572a-4913-b35f-7e53f317aafb service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] No waiting events found dispatching network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:07 user nova-compute[72178]: WARNING nova.compute.manager [req-b3b767da-2581-4c38-ba6d-28ea32a48b44 req-3a698dc3-572a-4913-b35f-7e53f317aafb service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received unexpected event network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c for instance with vm_state building and task_state spawning.
Aug 01 12:13:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.923s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:07 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.network.neutron [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:13:07 user nova-compute[72178]: INFO nova.virt.block_device [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Booting with volume snapshot 7457fba4-2743-40d5-a4d4-09788823b651 at /dev/vda
Aug 01 12:13:07 user nova-compute[72178]: DEBUG nova.policy [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef22394fbdfd4aad8c301596a2ee7b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0eb9e0006c46dabba55cc95cca217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:13:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:08 user nova-compute[72178]: DEBUG nova.network.neutron [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Successfully created port: 15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.compute.manager [req-9494b229-5be5-42b8-9c71-5a63994933ff req-c7d90404-1891-4ad2-9ed4-c4ed0d3a815d service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9494b229-5be5-42b8-9c71-5a63994933ff req-c7d90404-1891-4ad2-9ed4-c4ed0d3a815d service nova] Acquiring lock "8567b676-68ad-4869-8c32-babff84c347b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9494b229-5be5-42b8-9c71-5a63994933ff req-c7d90404-1891-4ad2-9ed4-c4ed0d3a815d service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9494b229-5be5-42b8-9c71-5a63994933ff req-c7d90404-1891-4ad2-9ed4-c4ed0d3a815d service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.compute.manager [req-9494b229-5be5-42b8-9c71-5a63994933ff req-c7d90404-1891-4ad2-9ed4-c4ed0d3a815d service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] No waiting events found dispatching network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:09 user nova-compute[72178]: WARNING nova.compute.manager [req-9494b229-5be5-42b8-9c71-5a63994933ff req-c7d90404-1891-4ad2-9ed4-c4ed0d3a815d service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received unexpected event network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c for instance with vm_state building and task_state spawning.
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891989.7060633, 8567b676-68ad-4869-8c32-babff84c347b => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] VM Resumed (Lifecycle Event)
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:13:09 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Instance spawned successfully.
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:13:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690891989.7075417, 8567b676-68ad-4869-8c32-babff84c347b => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] VM Started (Lifecycle Event)
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:13:09 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:13:09 user nova-compute[72178]: INFO nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Took 9.27 seconds to spawn the instance on the hypervisor.
Aug 01 12:13:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:10 user nova-compute[72178]: INFO nova.compute.manager [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Took 10.58 seconds to build instance.
Aug 01 12:13:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-96b0be2b-3980-45c2-9f65-b58220b94646 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "8567b676-68ad-4869-8c32-babff84c347b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.723s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG nova.network.neutron [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Successfully updated port: 15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquired lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG nova.network.neutron [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG nova.network.neutron [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG nova.network.neutron [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Updating instance_info_cache with network_info: [{"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Releasing lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Instance network_info: |[{"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:10 user nova-compute[72178]: INFO nova.compute.manager [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Detaching volume bcf7a021-79c4-41e1-a898-e4944a31ec3a
Aug 01 12:13:11 user nova-compute[72178]: INFO nova.virt.block_device [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attempting to driver detach volume bcf7a021-79c4-41e1-a898-e4944a31ec3a from mountpoint /dev/vdb
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Attempting to detach device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:13:11 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:13:11 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:13:11 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:13:11 user nova-compute[72178]:   <serial>bcf7a021-79c4-41e1-a898-e4944a31ec3a</serial>
Aug 01 12:13:11 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:13:11 user nova-compute[72178]: </disk>
Aug 01 12:13:11 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:13:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully detached device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the persistent domain config.
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:13:11 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:13:11 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:13:11 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:13:11 user nova-compute[72178]:   <serial>bcf7a021-79c4-41e1-a898-e4944a31ec3a</serial>
Aug 01 12:13:11 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:13:11 user nova-compute[72178]: </disk>
Aug 01 12:13:11 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690891991.5392303, febae49f-2d0b-4f28-a695-0ecaaf120077 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:13:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully detached device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the live domain config.
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbYTnMQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:13:11 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[20947fb5-cec7-4985-a038-ea7048852558]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fe4820-266a-45b9-82ae-aa115f40e681]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:13:11 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:13:11 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:13:11 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d43e8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a'): ({'sdf'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Removing single pathed devices sdf {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b4158-638d-4277-9450-aa59b2f32655]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a943d82-b9cd-4cab-a55d-bc1c10836c2e]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Flushing IO for device /dev/sdf {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[73742503-2700-40af-bf91-be2f3d88e7f2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-5d09740b-66ca-4253-8e4f-f835bd9d4b1e req-59f2cf93-4920-4a99-8091-1bc721396583 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received event network-changed-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-5d09740b-66ca-4253-8e4f-f835bd9d4b1e req-59f2cf93-4920-4a99-8091-1bc721396583 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Refreshing instance network info cache due to event network-changed-15719805-083a-4bd0-b4cf-1860e29883d7. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5d09740b-66ca-4253-8e4f-f835bd9d4b1e req-59f2cf93-4920-4a99-8091-1bc721396583 service nova] Acquiring lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5d09740b-66ca-4253-8e4f-f835bd9d4b1e req-59f2cf93-4920-4a99-8091-1bc721396583 service nova] Acquired lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.network.neutron [req-5d09740b-66ca-4253-8e4f-f835bd9d4b1e req-59f2cf93-4920-4a99-8091-1bc721396583 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Refreshing network info cache for port 15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c45ed3e-91e1-499c-8a0d-37b9cad0c53f]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e114e060-ebc7-44bc-94c0-69640ec70efb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[28712fe0-856b-4bb0-8c4c-50720c71407e]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a, portal: 172.16.0.220,3260]
Aug 01 12:13:11 user nova-compute[72178]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a, portal: 172.16.0.220,3260] successful.
Aug 01 12:13:11 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcf7a021-79c4-41e1-a898-e4944a31ec3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24ce0dd-364e-4826-96e0-88bef25c34a7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== disconnect_volume: return (374ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:13:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:13:12 user nova-compute[72178]: DEBUG nova.network.neutron [req-5d09740b-66ca-4253-8e4f-f835bd9d4b1e req-59f2cf93-4920-4a99-8091-1bc721396583 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Updated VIF entry in instance network info cache for port 15719805-083a-4bd0-b4cf-1860e29883d7. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:13:12 user nova-compute[72178]: DEBUG nova.network.neutron [req-5d09740b-66ca-4253-8e4f-f835bd9d4b1e req-59f2cf93-4920-4a99-8091-1bc721396583 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Updating instance_info_cache with network_info: [{"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5d09740b-66ca-4253-8e4f-f835bd9d4b1e req-59f2cf93-4920-4a99-8091-1bc721396583 service nova] Releasing lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:13:12 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8e631e54-ef6a-416a-82ac-0c46d7632a9d tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.129s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG os_brick.utils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc024b3-26d0-44f6-8cb9-2f5b14626e94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a3e59-920f-49f8-a64e-7c1e1b6cacef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[46307870-5179-43cc-8e79-271ea780371d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2632cb13-bf3f-4d46-9c06-70d9a164e94f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:13:13 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:13:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e715d49-6a88-4fbf-8784-f143183f43fe]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG os_brick.utils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:13:13 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Updating existing volume attachment record: d44b9f25-9c6d-4889-b0ab-ec62dc6d4a9f {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:13:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:13:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:15 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:13:15 user nova-compute[72178]: INFO nova.compute.claims [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Claim successful on node user
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:13:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.policy [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1158c8ff7efb465d9c7fdb7da7d22045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca4acce2204173bad928ab3c58d053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:13:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Creating image(s)
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk 1073741824" returned: 0 in 0.055s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Successfully created port: e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Cannot resize image /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'migration_context' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Ensure instance console log exists: /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Successfully updated port: e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquired lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-87a8f7b6-f64a-4313-99ff-f1da7532065a req-98751581-2e70-4587-b071-ae667bdfe657 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-changed-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-87a8f7b6-f64a-4313-99ff-f1da7532065a req-98751581-2e70-4587-b071-ae667bdfe657 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Refreshing instance network info cache due to event network-changed-e15e122f-e600-4d15-a508-998a84817013. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-87a8f7b6-f64a-4313-99ff-f1da7532065a req-98751581-2e70-4587-b071-ae667bdfe657 service nova] Acquiring lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Releasing lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance network_info: |[{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-87a8f7b6-f64a-4313-99ff-f1da7532065a req-98751581-2e70-4587-b071-ae667bdfe657 service nova] Acquired lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-87a8f7b6-f64a-4313-99ff-f1da7532065a req-98751581-2e70-4587-b071-ae667bdfe657 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Refreshing network info cache for port e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Start _get_guest_xml network_info=[{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:13:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:13:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:13:18 user nova-compute[72178]:   <uuid>6c816328-61df-4625-95e6-bc27fbd7148d</uuid>
Aug 01 12:13:18 user nova-compute[72178]:   <name>instance-00000024</name>
Aug 01 12:13:18 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:13:18 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:13:18 user nova-compute[72178]:   <metadata>
Aug 01 12:13:18 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:13:18 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:13:18 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeTestJSON-server-1912286508</nova:name>
Aug 01 12:13:18 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:13:18</nova:creationTime>
Aug 01 12:13:18 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:13:18 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:13:18 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:13:18 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:13:18 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:13:18 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:13:18 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:13:18 user nova-compute[72178]:       <nova:owner>
Aug 01 12:13:18 user nova-compute[72178]:         <nova:user uuid="1158c8ff7efb465d9c7fdb7da7d22045">tempest-AttachVolumeTestJSON-236294761-project-member</nova:user>
Aug 01 12:13:18 user nova-compute[72178]:         <nova:project uuid="c5ca4acce2204173bad928ab3c58d053">tempest-AttachVolumeTestJSON-236294761</nova:project>
Aug 01 12:13:18 user nova-compute[72178]:       </nova:owner>
Aug 01 12:13:18 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:13:18 user nova-compute[72178]:       <nova:ports>
Aug 01 12:13:18 user nova-compute[72178]:         <nova:port uuid="e15e122f-e600-4d15-a508-998a84817013">
Aug 01 12:13:18 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 12:13:18 user nova-compute[72178]:         </nova:port>
Aug 01 12:13:18 user nova-compute[72178]:       </nova:ports>
Aug 01 12:13:18 user nova-compute[72178]:     </nova:instance>
Aug 01 12:13:18 user nova-compute[72178]:   </metadata>
Aug 01 12:13:18 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:13:18 user nova-compute[72178]:     <system>
Aug 01 12:13:18 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:13:18 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:13:18 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:13:18 user nova-compute[72178]:       <entry name="serial">6c816328-61df-4625-95e6-bc27fbd7148d</entry>
Aug 01 12:13:18 user nova-compute[72178]:       <entry name="uuid">6c816328-61df-4625-95e6-bc27fbd7148d</entry>
Aug 01 12:13:18 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:13:18 user nova-compute[72178]:     </system>
Aug 01 12:13:18 user nova-compute[72178]:   </sysinfo>
Aug 01 12:13:18 user nova-compute[72178]:   <os>
Aug 01 12:13:18 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:13:18 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:13:18 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:13:18 user nova-compute[72178]:   </os>
Aug 01 12:13:18 user nova-compute[72178]:   <features>
Aug 01 12:13:18 user nova-compute[72178]:     <acpi/>
Aug 01 12:13:18 user nova-compute[72178]:     <apic/>
Aug 01 12:13:18 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:13:18 user nova-compute[72178]:   </features>
Aug 01 12:13:18 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:13:18 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:13:18 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:13:18 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:13:18 user nova-compute[72178]:   </clock>
Aug 01 12:13:18 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:13:18 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:13:18 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:13:18 user nova-compute[72178]:   </cpu>
Aug 01 12:13:18 user nova-compute[72178]:   <devices>
Aug 01 12:13:18 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:13:18 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:13:18 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk"/>
Aug 01 12:13:18 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:13:18 user nova-compute[72178]:     </disk>
Aug 01 12:13:18 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:13:18 user nova-compute[72178]:       <mac address="fa:16:3e:de:3e:66"/>
Aug 01 12:13:18 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:13:18 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:13:18 user nova-compute[72178]:       <target dev="tape15e122f-e6"/>
Aug 01 12:13:18 user nova-compute[72178]:     </interface>
Aug 01 12:13:18 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:13:18 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/console.log" append="off"/>
Aug 01 12:13:18 user nova-compute[72178]:     </serial>
Aug 01 12:13:18 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:13:18 user nova-compute[72178]:     <video>
Aug 01 12:13:18 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:13:18 user nova-compute[72178]:     </video>
Aug 01 12:13:18 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:13:18 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:13:18 user nova-compute[72178]:     </rng>
Aug 01 12:13:18 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:13:18 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:13:18 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:13:18 user nova-compute[72178]:     </memballoon>
Aug 01 12:13:18 user nova-compute[72178]:   </devices>
Aug 01 12:13:18 user nova-compute[72178]: </domain>
Aug 01 12:13:18 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG os_vif [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape15e122f-e6, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape15e122f-e6, col_values=(('external_ids', {'iface-id': 'e15e122f-e600-4d15-a508-998a84817013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:3e:66', 'vm-uuid': '6c816328-61df-4625-95e6-bc27fbd7148d'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:18 user nova-compute[72178]: INFO os_vif [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6')
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No VIF found with MAC fa:16:3e:de:3e:66, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-87a8f7b6-f64a-4313-99ff-f1da7532065a req-98751581-2e70-4587-b071-ae667bdfe657 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updated VIF entry in instance network info cache for port e15e122f-e600-4d15-a508-998a84817013. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-87a8f7b6-f64a-4313-99ff-f1da7532065a req-98751581-2e70-4587-b071-ae667bdfe657 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-87a8f7b6-f64a-4313-99ff-f1da7532065a req-98751581-2e70-4587-b071-ae667bdfe657 service nova] Releasing lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:13:19 user nova-compute[72178]: INFO nova.compute.manager [None req-d57c2ccc-28bc-4747-a0f8-db27af82e25a tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Get console output
Aug 01 12:13:19 user nova-compute[72178]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 01 12:13:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-b8a25ae6-7e23-447e-948d-03693944f2d7 req-93f0bd13-a9ea-4c2d-ab9f-b9d9ce084ce9 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8a25ae6-7e23-447e-948d-03693944f2d7 req-93f0bd13-a9ea-4c2d-ab9f-b9d9ce084ce9 service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8a25ae6-7e23-447e-948d-03693944f2d7 req-93f0bd13-a9ea-4c2d-ab9f-b9d9ce084ce9 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b8a25ae6-7e23-447e-948d-03693944f2d7 req-93f0bd13-a9ea-4c2d-ab9f-b9d9ce084ce9 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-b8a25ae6-7e23-447e-948d-03693944f2d7 req-93f0bd13-a9ea-4c2d-ab9f-b9d9ce084ce9 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:20 user nova-compute[72178]: WARNING nova.compute.manager [req-b8a25ae6-7e23-447e-948d-03693944f2d7 req-93f0bd13-a9ea-4c2d-ab9f-b9d9ce084ce9 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state building and task_state spawning.
Aug 01 12:13:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:13:22 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Creating image(s)
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Ensure instance console log exists: /opt/stack/data/nova/instances/155adc09-065e-425b-8573-7b1be9aa030b/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Start _get_guest_xml network_info=[{"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T12:12:58Z,direct_url=<?>,disk_format='qcow2',id=e323a4e0-b861-433b-afc9-6348c4d9d324,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1544344106',owner='1e0eb9e0006c46dabba55cc95cca217f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T12:12:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpQbmfPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '155adc09-065e-425b-8573-7b1be9aa030b', 'attached_at': '', 'detached_at': '', 'volume_id': '0ede5fb4-4c22-42ad-a16d-48c522e2f554', 'serial': '0ede5fb4-4c22-42ad-a16d-48c522e2f554'}, 'boot_index': 0, 'attachment_id': 'd44b9f25-9c6d-4889-b0ab-ec62dc6d4a9f', 'delete_on_termination': True, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:13:22 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:13:22 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-01T12:12:58Z,direct_url=<?>,disk_format='qcow2',id=e323a4e0-b861-433b-afc9-6348c4d9d324,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1544344106',owner='1e0eb9e0006c46dabba55cc95cca217f',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-01T12:12:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpQbmfPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:13:22 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:13:22 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:13:22 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f843d1d-4772-4754-83a1-707c6c3b3893]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:13:22 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6757b226-0ae0-44df-be26-2dc517121234]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554] added
Aug 01 12:13:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4a213e-eef4-495a-84c4-35d23a3a9bce]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac3dda6-3d0e-43d0-9ac2-28c7092bf8d7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpQbmfPu {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CpQbmfPu" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccc4c98-6222-43fc-a5e6-ed101def8ac4]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CpQbmfPu'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[307a0592-fc3e-43fc-9340-3f3e0dc2ffa7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1eea9e-929f-4a59-97fc-a89bb0ef5932]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892002.4012616, 6c816328-61df-4625-95e6-bc27fbd7148d => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Resumed (Lifecycle Event)
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830f76a-80f3-470c-a216-b7220c45febf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554, portal: 172.16.0.220,3260]
Aug 01 12:13:22 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554, portal: 172.16.0.220,3260] successful.
Aug 01 12:13:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance spawned successfully.
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892002.40272, 6c816328-61df-4625-95e6-bc27fbd7148d => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Started (Lifecycle Event)
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.061s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[162285e0-7883-4833-8943-eae2219b90a3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:13:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-e0e7e22e-e2de-4f9f-9ab8-581d99e0bc66 req-0110bb65-604d-498d-9730-f3648a0c851a service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0e7e22e-e2de-4f9f-9ab8-581d99e0bc66 req-0110bb65-604d-498d-9730-f3648a0c851a service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0e7e22e-e2de-4f9f-9ab8-581d99e0bc66 req-0110bb65-604d-498d-9730-f3648a0c851a service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0e7e22e-e2de-4f9f-9ab8-581d99e0bc66 req-0110bb65-604d-498d-9730-f3648a0c851a service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-e0e7e22e-e2de-4f9f-9ab8-581d99e0bc66 req-0110bb65-604d-498d-9730-f3648a0c851a service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:22 user nova-compute[72178]: WARNING nova.compute.manager [req-e0e7e22e-e2de-4f9f-9ab8-581d99e0bc66 req-0110bb65-604d-498d-9730-f3648a0c851a service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state building and task_state spawning.
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe59b7-4ea5-44bd-ada1-322ad3ac7360]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:13:22 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:22 user nova-compute[72178]: INFO nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Took 5.87 seconds to spawn the instance on the hypervisor.
Aug 01 12:13:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f070e7bd-4f60-46f2-a210-80a6d846889f]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:13:22 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpQbmfPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:13:22 user nova-compute[72178]: INFO nova.compute.manager [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Took 6.88 seconds to build instance.
Aug 01 12:13:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-08167dfd-ad02-474f-ab47-1cbf9483e6cf tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.974s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26263363466366631', 'path': '/dev/sdf'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263363466366631', 'path': '/dev/sdf'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2138167455',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2138167455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2138167455',id=35,image_ref='e323a4e0-b861-433b-afc9-6348c4d9d324',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClvwM6CD3sV12gNUdZ2Kw64Eeaco3tlIZFGTtRXpf0jJhhI0bpefa7Qy05tgv8EXZVmQ9bBE19fEgyXC4RQ3FuOFpJZTV2evGkWzgc61JUTT0CZxmAsKJTCQF3O4jzkCA==',key_name='tempest-keypair-1988468850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-0crqhl06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1003407750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=155adc09-065e-425b-8573-7b1be9aa030b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:79:e6,bridge_name='br-int',has_traffic_filtering=True,id=15719805-083a-4bd0-b4cf-1860e29883d7,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15719805-08') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.objects.instance [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'pci_devices' on Instance uuid 155adc09-065e-425b-8573-7b1be9aa030b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:13:23 user nova-compute[72178]:   <uuid>155adc09-065e-425b-8573-7b1be9aa030b</uuid>
Aug 01 12:13:23 user nova-compute[72178]:   <name>instance-00000023</name>
Aug 01 12:13:23 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:13:23 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:13:23 user nova-compute[72178]:   <metadata>
Aug 01 12:13:23 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:13:23 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:13:23 user nova-compute[72178]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2138167455</nova:name>
Aug 01 12:13:23 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:13:22</nova:creationTime>
Aug 01 12:13:23 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:13:23 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:13:23 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:13:23 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:13:23 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:13:23 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:13:23 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:13:23 user nova-compute[72178]:       <nova:owner>
Aug 01 12:13:23 user nova-compute[72178]:         <nova:user uuid="ef22394fbdfd4aad8c301596a2ee7b61">tempest-TestVolumeBootPattern-1003407750-project-member</nova:user>
Aug 01 12:13:23 user nova-compute[72178]:         <nova:project uuid="1e0eb9e0006c46dabba55cc95cca217f">tempest-TestVolumeBootPattern-1003407750</nova:project>
Aug 01 12:13:23 user nova-compute[72178]:       </nova:owner>
Aug 01 12:13:23 user nova-compute[72178]:       <nova:root type="image" uuid="e323a4e0-b861-433b-afc9-6348c4d9d324"/>
Aug 01 12:13:23 user nova-compute[72178]:       <nova:ports>
Aug 01 12:13:23 user nova-compute[72178]:         <nova:port uuid="15719805-083a-4bd0-b4cf-1860e29883d7">
Aug 01 12:13:23 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 12:13:23 user nova-compute[72178]:         </nova:port>
Aug 01 12:13:23 user nova-compute[72178]:       </nova:ports>
Aug 01 12:13:23 user nova-compute[72178]:     </nova:instance>
Aug 01 12:13:23 user nova-compute[72178]:   </metadata>
Aug 01 12:13:23 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:13:23 user nova-compute[72178]:     <system>
Aug 01 12:13:23 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:13:23 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:13:23 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:13:23 user nova-compute[72178]:       <entry name="serial">155adc09-065e-425b-8573-7b1be9aa030b</entry>
Aug 01 12:13:23 user nova-compute[72178]:       <entry name="uuid">155adc09-065e-425b-8573-7b1be9aa030b</entry>
Aug 01 12:13:23 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:13:23 user nova-compute[72178]:     </system>
Aug 01 12:13:23 user nova-compute[72178]:   </sysinfo>
Aug 01 12:13:23 user nova-compute[72178]:   <os>
Aug 01 12:13:23 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:13:23 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:13:23 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:13:23 user nova-compute[72178]:   </os>
Aug 01 12:13:23 user nova-compute[72178]:   <features>
Aug 01 12:13:23 user nova-compute[72178]:     <acpi/>
Aug 01 12:13:23 user nova-compute[72178]:     <apic/>
Aug 01 12:13:23 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:13:23 user nova-compute[72178]:   </features>
Aug 01 12:13:23 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:13:23 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:13:23 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:13:23 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:13:23 user nova-compute[72178]:   </clock>
Aug 01 12:13:23 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:13:23 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:13:23 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:13:23 user nova-compute[72178]:   </cpu>
Aug 01 12:13:23 user nova-compute[72178]:   <devices>
Aug 01 12:13:23 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:13:23 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:13:23 user nova-compute[72178]:       <source dev="/dev/sdf"/>
Aug 01 12:13:23 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:13:23 user nova-compute[72178]:       <serial>0ede5fb4-4c22-42ad-a16d-48c522e2f554</serial>
Aug 01 12:13:23 user nova-compute[72178]:     </disk>
Aug 01 12:13:23 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:13:23 user nova-compute[72178]:       <mac address="fa:16:3e:9d:79:e6"/>
Aug 01 12:13:23 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:13:23 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:13:23 user nova-compute[72178]:       <target dev="tap15719805-08"/>
Aug 01 12:13:23 user nova-compute[72178]:     </interface>
Aug 01 12:13:23 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:13:23 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/155adc09-065e-425b-8573-7b1be9aa030b/console.log" append="off"/>
Aug 01 12:13:23 user nova-compute[72178]:     </serial>
Aug 01 12:13:23 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:13:23 user nova-compute[72178]:     <video>
Aug 01 12:13:23 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:13:23 user nova-compute[72178]:     </video>
Aug 01 12:13:23 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:13:23 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:13:23 user nova-compute[72178]:     </rng>
Aug 01 12:13:23 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:13:23 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:13:23 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:13:23 user nova-compute[72178]:     </memballoon>
Aug 01 12:13:23 user nova-compute[72178]:   </devices>
Aug 01 12:13:23 user nova-compute[72178]: </domain>
Aug 01 12:13:23 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2138167455',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2138167455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2138167455',id=35,image_ref='e323a4e0-b861-433b-afc9-6348c4d9d324',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClvwM6CD3sV12gNUdZ2Kw64Eeaco3tlIZFGTtRXpf0jJhhI0bpefa7Qy05tgv8EXZVmQ9bBE19fEgyXC4RQ3FuOFpJZTV2evGkWzgc61JUTT0CZxmAsKJTCQF3O4jzkCA==',key_name='tempest-keypair-1988468850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-0crqhl06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1003407750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:13:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=155adc09-065e-425b-8573-7b1be9aa030b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:79:e6,bridge_name='br-int',has_traffic_filtering=True,id=15719805-083a-4bd0-b4cf-1860e29883d7,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15719805-08') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG os_vif [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:79:e6,bridge_name='br-int',has_traffic_filtering=True,id=15719805-083a-4bd0-b4cf-1860e29883d7,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15719805-08') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15719805-08, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15719805-08, col_values=(('external_ids', {'iface-id': '15719805-083a-4bd0-b4cf-1860e29883d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:79:e6', 'vm-uuid': '155adc09-065e-425b-8573-7b1be9aa030b'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:23 user nova-compute[72178]: INFO os_vif [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:79:e6,bridge_name='br-int',has_traffic_filtering=True,id=15719805-083a-4bd0-b4cf-1860e29883d7,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15719805-08')
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:13:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No VIF found with MAC fa:16:3e:9d:79:e6, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:13:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:25 user nova-compute[72178]: DEBUG nova.compute.manager [req-1ba3986e-b606-4d07-9abb-9d225e3e15ee req-caefb5a0-fca9-409e-b946-206945863f9e service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received event network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ba3986e-b606-4d07-9abb-9d225e3e15ee req-caefb5a0-fca9-409e-b946-206945863f9e service nova] Acquiring lock "155adc09-065e-425b-8573-7b1be9aa030b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ba3986e-b606-4d07-9abb-9d225e3e15ee req-caefb5a0-fca9-409e-b946-206945863f9e service nova] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1ba3986e-b606-4d07-9abb-9d225e3e15ee req-caefb5a0-fca9-409e-b946-206945863f9e service nova] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:25 user nova-compute[72178]: DEBUG nova.compute.manager [req-1ba3986e-b606-4d07-9abb-9d225e3e15ee req-caefb5a0-fca9-409e-b946-206945863f9e service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] No waiting events found dispatching network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:25 user nova-compute[72178]: WARNING nova.compute.manager [req-1ba3986e-b606-4d07-9abb-9d225e3e15ee req-caefb5a0-fca9-409e-b946-206945863f9e service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received unexpected event network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 for instance with vm_state building and task_state spawning.
Aug 01 12:13:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-2a71f8e9-5850-40f6-b6cb-9d1772ff7f2a req-3bde3015-2b62-443c-af6d-5c80124fbb61 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received event network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a71f8e9-5850-40f6-b6cb-9d1772ff7f2a req-3bde3015-2b62-443c-af6d-5c80124fbb61 service nova] Acquiring lock "155adc09-065e-425b-8573-7b1be9aa030b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a71f8e9-5850-40f6-b6cb-9d1772ff7f2a req-3bde3015-2b62-443c-af6d-5c80124fbb61 service nova] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2a71f8e9-5850-40f6-b6cb-9d1772ff7f2a req-3bde3015-2b62-443c-af6d-5c80124fbb61 service nova] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-2a71f8e9-5850-40f6-b6cb-9d1772ff7f2a req-3bde3015-2b62-443c-af6d-5c80124fbb61 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] No waiting events found dispatching network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:27 user nova-compute[72178]: WARNING nova.compute.manager [req-2a71f8e9-5850-40f6-b6cb-9d1772ff7f2a req-3bde3015-2b62-443c-af6d-5c80124fbb61 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received unexpected event network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 for instance with vm_state building and task_state spawning.
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892007.5276582, 155adc09-065e-425b-8573-7b1be9aa030b => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] VM Resumed (Lifecycle Event)
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:13:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Instance spawned successfully.
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:13:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892007.5289428, 155adc09-065e-425b-8573-7b1be9aa030b => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] VM Started (Lifecycle Event)
Aug 01 12:13:27 user nova-compute[72178]: INFO nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Took 5.53 seconds to spawn the instance on the hypervisor.
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:13:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:13:27 user nova-compute[72178]: INFO nova.compute.manager [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Took 21.05 seconds to build instance.
Aug 01 12:13:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cbade45e-5d38-44ef-85c7-1c416ffed301 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "155adc09-065e-425b-8573-7b1be9aa030b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.169s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:34 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:13:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:13:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:13:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:13:34 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:13:34 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updating instance_info_cache with network_info: [{"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-8ac32412-1f05-4d62-a184-0b90f1b3d21c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:13:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:13:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:13:35 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:40 user nova-compute[72178]: INFO nova.compute.manager [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Terminating instance
Aug 01 12:13:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:13:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-a1f212ff-9286-44be-88c7-3924694ab697 req-b9d0bce4-567e-4292-825a-b57a5270e0da service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-unplugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a1f212ff-9286-44be-88c7-3924694ab697 req-b9d0bce4-567e-4292-825a-b57a5270e0da service nova] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a1f212ff-9286-44be-88c7-3924694ab697 req-b9d0bce4-567e-4292-825a-b57a5270e0da service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a1f212ff-9286-44be-88c7-3924694ab697 req-b9d0bce4-567e-4292-825a-b57a5270e0da service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-a1f212ff-9286-44be-88c7-3924694ab697 req-b9d0bce4-567e-4292-825a-b57a5270e0da service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] No waiting events found dispatching network-vif-unplugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-a1f212ff-9286-44be-88c7-3924694ab697 req-b9d0bce4-567e-4292-825a-b57a5270e0da service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-unplugged-729998f1-8451-468a-a2d8-8612146ac1e3 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:13:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Instance destroyed successfully.
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'resources' on Instance uuid 326f0759-29ce-4441-ba2a-7a74d8726eb7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-187040838',display_name='tempest-ServerRescueNegativeTestJSON-server-187040838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-187040838',id=5,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:00:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-r0egeg4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:50Z,user_data=None,user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=326f0759-29ce-4441-ba2a-7a74d8726eb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "729998f1-8451-468a-a2d8-8612146ac1e3", "address": "fa:16:3e:c3:3c:55", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap729998f1-84", "ovs_interfaceid": "729998f1-8451-468a-a2d8-8612146ac1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:3c:55,bridge_name='br-int',has_traffic_filtering=True,id=729998f1-8451-468a-a2d8-8612146ac1e3,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap729998f1-84') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG os_vif [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:3c:55,bridge_name='br-int',has_traffic_filtering=True,id=729998f1-8451-468a-a2d8-8612146ac1e3,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap729998f1-84') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap729998f1-84, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:13:41 user nova-compute[72178]: INFO os_vif [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:3c:55,bridge_name='br-int',has_traffic_filtering=True,id=729998f1-8451-468a-a2d8-8612146ac1e3,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap729998f1-84')
Aug 01 12:13:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Deleting instance files /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7_del
Aug 01 12:13:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Deletion of /opt/stack/data/nova/instances/326f0759-29ce-4441-ba2a-7a74d8726eb7_del complete
Aug 01 12:13:41 user nova-compute[72178]: INFO nova.compute.manager [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Took 0.76 seconds to destroy the instance on the hypervisor.
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:13:41 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid '326f0759-29ce-4441-ba2a-7a74d8726eb7' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid '326f0759-29ce-4441-ba2a-7a74d8726eb7' (instance-00000005)
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG nova.compute.manager [req-491450cd-9fa6-4bf4-a2c7-16f220b140cc req-349e5caf-69cf-4b74-afa7-39abb086cf02 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-deleted-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:42 user nova-compute[72178]: INFO nova.compute.manager [req-491450cd-9fa6-4bf4-a2c7-16f220b140cc req-349e5caf-69cf-4b74-afa7-39abb086cf02 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Neutron deleted interface 729998f1-8451-468a-a2d8-8612146ac1e3; detaching it from the instance and deleting it from the info cache
Aug 01 12:13:42 user nova-compute[72178]: DEBUG nova.network.neutron [req-491450cd-9fa6-4bf4-a2c7-16f220b140cc req-349e5caf-69cf-4b74-afa7-39abb086cf02 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:42 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Took 0.77 seconds to deallocate network for instance.
Aug 01 12:13:42 user nova-compute[72178]: DEBUG nova.compute.manager [req-491450cd-9fa6-4bf4-a2c7-16f220b140cc req-349e5caf-69cf-4b74-afa7-39abb086cf02 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Detach interface failed, port_id=729998f1-8451-468a-a2d8-8612146ac1e3, reason: Instance 326f0759-29ce-4441-ba2a-7a74d8726eb7 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.786s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:43 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Deleted allocations for instance 326f0759-29ce-4441-ba2a-7a74d8726eb7
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-9cd9daf6-f24c-41d0-bb36-8a7764c11416 req-4adcb74f-7627-4185-b1ec-bf1f7c537393 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cd9daf6-f24c-41d0-bb36-8a7764c11416 req-4adcb74f-7627-4185-b1ec-bf1f7c537393 service nova] Acquiring lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cd9daf6-f24c-41d0-bb36-8a7764c11416 req-4adcb74f-7627-4185-b1ec-bf1f7c537393 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9cd9daf6-f24c-41d0-bb36-8a7764c11416 req-4adcb74f-7627-4185-b1ec-bf1f7c537393 service nova] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-9cd9daf6-f24c-41d0-bb36-8a7764c11416 req-4adcb74f-7627-4185-b1ec-bf1f7c537393 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] No waiting events found dispatching network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:43 user nova-compute[72178]: WARNING nova.compute.manager [req-9cd9daf6-f24c-41d0-bb36-8a7764c11416 req-4adcb74f-7627-4185-b1ec-bf1f7c537393 service nova] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Received unexpected event network-vif-plugged-729998f1-8451-468a-a2d8-8612146ac1e3 for instance with vm_state deleted and task_state None.
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a2f4c510-ac33-4610-8198-961b324c2bfd tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "326f0759-29ce-4441-ba2a-7a74d8726eb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.536s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:13:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:13:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:13:45 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:13:45 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:13:45 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=6279MB free_disk=24.92159652709961GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:13:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e7e1d3fe-99fe-41fe-bff7-5ea191c529de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 776b71c1-6696-4575-9c0d-e9340af62167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance febae49f-2d0b-4f28-a695-0ecaaf120077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance be40c1ae-0b3e-43c6-804b-ce8158b49233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d6ab7d82-da92-460f-9172-b635d396513e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 48f2834c-c573-46cd-98ec-d5d90e721c6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance c2b7b3b8-1ed3-4754-9699-16839c7394c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance c4621d07-791b-49da-97b3-aa8558914e7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8567b676-68ad-4869-8c32-babff84c347b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 155adc09-065e-425b-8573-7b1be9aa030b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:13:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:13:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:56 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892021.449953, 326f0759-29ce-4441-ba2a-7a74d8726eb7 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:13:56 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] VM Stopped (Lifecycle Event)
Aug 01 12:13:56 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a8c2f0d0-b3b9-4759-946a-00c826e7b9b4 None None] [instance: 326f0759-29ce-4441-ba2a-7a74d8726eb7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:13:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "48f2834c-c573-46cd-98ec-d5d90e721c6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:57 user nova-compute[72178]: INFO nova.compute.manager [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Terminating instance
Aug 01 12:13:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-34d06bbf-546f-4d8f-aacb-1a5c46750e60 req-f36e6171-78de-4e38-a5a4-ae5e12359ac6 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received event network-vif-unplugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-34d06bbf-546f-4d8f-aacb-1a5c46750e60 req-f36e6171-78de-4e38-a5a4-ae5e12359ac6 service nova] Acquiring lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-34d06bbf-546f-4d8f-aacb-1a5c46750e60 req-f36e6171-78de-4e38-a5a4-ae5e12359ac6 service nova] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-34d06bbf-546f-4d8f-aacb-1a5c46750e60 req-f36e6171-78de-4e38-a5a4-ae5e12359ac6 service nova] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-34d06bbf-546f-4d8f-aacb-1a5c46750e60 req-f36e6171-78de-4e38-a5a4-ae5e12359ac6 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] No waiting events found dispatching network-vif-unplugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-34d06bbf-546f-4d8f-aacb-1a5c46750e60 req-f36e6171-78de-4e38-a5a4-ae5e12359ac6 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received event network-vif-unplugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:13:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Instance destroyed successfully.
Aug 01 12:13:57 user nova-compute[72178]: DEBUG nova.objects.instance [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lazy-loading 'resources' on Instance uuid 48f2834c-c573-46cd-98ec-d5d90e721c6b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-185703279',display_name='tempest-VolumesActionsTest-instance-185703279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-185703279',id=32,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:12:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e82a73d8a1944928b14ff263f3a2d385',ramdisk_id='',reservation_id='r-yhpnwka5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-439234941',owner_user_name='tempest-VolumesActionsTest-439234941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:12:13Z,user_data=None,user_id='ec07389bdd7847469b8376941948997c',uuid=48f2834c-c573-46cd-98ec-d5d90e721c6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converting VIF {"id": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "address": "fa:16:3e:af:49:14", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap737a7e5c-d5", "ovs_interfaceid": "737a7e5c-d588-4fe6-8e31-b96c4191f14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:14,bridge_name='br-int',has_traffic_filtering=True,id=737a7e5c-d588-4fe6-8e31-b96c4191f14c,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a7e5c-d5') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG os_vif [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:14,bridge_name='br-int',has_traffic_filtering=True,id=737a7e5c-d588-4fe6-8e31-b96c4191f14c,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a7e5c-d5') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap737a7e5c-d5, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:13:57 user nova-compute[72178]: INFO os_vif [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:49:14,bridge_name='br-int',has_traffic_filtering=True,id=737a7e5c-d588-4fe6-8e31-b96c4191f14c,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap737a7e5c-d5')
Aug 01 12:13:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Deleting instance files /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b_del
Aug 01 12:13:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Deletion of /opt/stack/data/nova/instances/48f2834c-c573-46cd-98ec-d5d90e721c6b_del complete
Aug 01 12:13:58 user nova-compute[72178]: INFO nova.compute.manager [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 01 12:13:58 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:13:58 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:13:58 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:13:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:13:58 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:13:58 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Took 0.50 seconds to deallocate network for instance.
Aug 01 12:13:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-4cec151c-9ed9-4aa7-abb6-eb5924fd8e1d req-215275a1-0b0e-4e56-95b6-b0ac9b4325b3 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received event network-vif-deleted-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:59 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:13:59 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:13:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.463s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:59 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Deleted allocations for instance 48f2834c-c573-46cd-98ec-d5d90e721c6b
Aug 01 12:13:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-38367be4-2f34-437f-9c6e-cdff81fd0674 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee6c7219-f693-4340-9de6-dc48fecd99dd req-818c1260-9817-44c2-afe4-a07cbd592b70 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received event network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:13:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee6c7219-f693-4340-9de6-dc48fecd99dd req-818c1260-9817-44c2-afe4-a07cbd592b70 service nova] Acquiring lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:13:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee6c7219-f693-4340-9de6-dc48fecd99dd req-818c1260-9817-44c2-afe4-a07cbd592b70 service nova] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:13:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee6c7219-f693-4340-9de6-dc48fecd99dd req-818c1260-9817-44c2-afe4-a07cbd592b70 service nova] Lock "48f2834c-c573-46cd-98ec-d5d90e721c6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:13:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee6c7219-f693-4340-9de6-dc48fecd99dd req-818c1260-9817-44c2-afe4-a07cbd592b70 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] No waiting events found dispatching network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:13:59 user nova-compute[72178]: WARNING nova.compute.manager [req-ee6c7219-f693-4340-9de6-dc48fecd99dd req-818c1260-9817-44c2-afe4-a07cbd592b70 service nova] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Received unexpected event network-vif-plugged-737a7e5c-d588-4fe6-8e31-b96c4191f14c for instance with vm_state deleted and task_state None.
Aug 01 12:14:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:04 user nova-compute[72178]: INFO nova.compute.manager [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attaching volume 5fef2f7b-68d3-47cb-b6db-c8a04172da54 to /dev/vdb
Aug 01 12:14:04 user nova-compute[72178]: DEBUG os_brick.utils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd49909-8e87-4d17-8ad0-091d85ba982b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4877442-62db-479f-8b31-256a4675f6a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dabd88-11db-4500-a6e9-ec7784acf5cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2330c0-e13b-4e8a-9353-4319c63818fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:14:04 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:14:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[95410e23-eaf4-4732-b4c1-6384a37dcdc5]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG os_brick.utils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:14:04 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating existing volume attachment record: 07fb0861-7b01-476c-aca1-39ec005b0660 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:14:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:11 user nova-compute[72178]: INFO nova.compute.manager [None req-daad8f71-9e71-4826-ad51-fb0132f67ece tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Unrescuing
Aug 01 12:14:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-daad8f71-9e71-4826-ad51-fb0132f67ece tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-daad8f71-9e71-4826-ad51-fb0132f67ece tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquired lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-daad8f71-9e71-4826-ad51-fb0132f67ece tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:14:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-daad8f71-9e71-4826-ad51-fb0132f67ece tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Updating instance_info_cache with network_info: [{"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-daad8f71-9e71-4826-ad51-fb0132f67ece tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Releasing lock "refresh_cache-776b71c1-6696-4575-9c0d-e9340af62167" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:11 user nova-compute[72178]: DEBUG nova.objects.instance [None req-daad8f71-9e71-4826-ad51-fb0132f67ece tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'flavor' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-eb965b16-1743-4fee-9dcf-ee4fbf22d2cb req-8c61b8cf-6f11-40d1-bfb8-1b154860ddd8 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eb965b16-1743-4fee-9dcf-ee4fbf22d2cb req-8c61b8cf-6f11-40d1-bfb8-1b154860ddd8 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eb965b16-1743-4fee-9dcf-ee4fbf22d2cb req-8c61b8cf-6f11-40d1-bfb8-1b154860ddd8 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eb965b16-1743-4fee-9dcf-ee4fbf22d2cb req-8c61b8cf-6f11-40d1-bfb8-1b154860ddd8 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG nova.compute.manager [req-eb965b16-1743-4fee-9dcf-ee4fbf22d2cb req-8c61b8cf-6f11-40d1-bfb8-1b154860ddd8 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:12 user nova-compute[72178]: WARNING nova.compute.manager [req-eb965b16-1743-4fee-9dcf-ee4fbf22d2cb req-8c61b8cf-6f11-40d1-bfb8-1b154860ddd8 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQwjiZsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:14:12 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:14:12 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:14:12 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance destroyed successfully.
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8b4dff-21a1-4201-85e4-92e3d4c5ee67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:14:12 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9f430e-d825-42e9-964e-1c5d5bffc4f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54] added
Aug 01 12:14:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b10b71-cd95-41d0-a356-7d548a1c1438]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c0593d-b954-4669-a41d-0e81684194c3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQwjiZsL {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eQwjiZsL" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a12a2a-9b0f-4f3f-bde9-1cbd6eccdba7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eQwjiZsL'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b44576-aba4-49f1-84d7-a1bd8f21cf9b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a5b3e1-c7b7-41da-92b7-cba12ae3509c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[db91dcc8-487d-41ae-a569-5b941a2a1b70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54, portal: 172.16.0.220,3260]
Aug 01 12:14:12 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54, portal: 172.16.0.220,3260] successful.
Aug 01 12:14:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892037.9463198, 48f2834c-c573-46cd-98ec-d5d90e721c6b => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:14:12 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] VM Stopped (Lifecycle Event)
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a2929f-d225-4163-87ae-06f016ec440d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG nova.compute.manager [None req-867708f1-79b2-4fcd-96ac-3eaabb885fb6 None None] [instance: 48f2834c-c573-46cd-98ec-d5d90e721c6b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a554bda1-5f3d-4a0f-9e90-351c18a72c1c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 (non-flash)
Aug 01 12:14:12 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] HCTL ('40', '-', '-', 0) found on session 39 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:14:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e98cc3-d1e5-4568-b055-56166b86c68e]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Searching for a device in session 39 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQwjiZsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '26533373133653433', 'path': '/dev/sdi'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533373133653433', 'path': '/dev/sdi'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:14:14 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:14:14 user nova-compute[72178]:   <source dev="/dev/sdi"/>
Aug 01 12:14:14 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:14:14 user nova-compute[72178]:   <serial>5fef2f7b-68d3-47cb-b6db-c8a04172da54</serial>
Aug 01 12:14:14 user nova-compute[72178]: </disk>
Aug 01 12:14:14 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:14 user nova-compute[72178]: WARNING nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:14 user nova-compute[72178]: WARNING nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:14 user nova-compute[72178]: WARNING nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:14 user nova-compute[72178]: WARNING nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:14 user nova-compute[72178]: WARNING nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:14 user nova-compute[72178]: WARNING nova.compute.manager [req-f2bd9a55-366e-4472-9ce5-ca7ac4a46d31 req-481d3765-fc44-416d-b89d-0f847689d216 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:14:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:14:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:14:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No VIF found with MAC fa:16:3e:d2:93:c8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:14:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7ae13af5-97c7-4c15-bf32-c5ccb4facbbc tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.813s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-bcd8ed7d-2ff9-4f32-908f-534ed75ab955 req-1d8631e6-7ec1-4118-9f19-a88900a403d8 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bcd8ed7d-2ff9-4f32-908f-534ed75ab955 req-1d8631e6-7ec1-4118-9f19-a88900a403d8 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bcd8ed7d-2ff9-4f32-908f-534ed75ab955 req-1d8631e6-7ec1-4118-9f19-a88900a403d8 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bcd8ed7d-2ff9-4f32-908f-534ed75ab955 req-1d8631e6-7ec1-4118-9f19-a88900a403d8 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-bcd8ed7d-2ff9-4f32-908f-534ed75ab955 req-1d8631e6-7ec1-4118-9f19-a88900a403d8 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:16 user nova-compute[72178]: WARNING nova.compute.manager [req-bcd8ed7d-2ff9-4f32-908f-534ed75ab955 req-1d8631e6-7ec1-4118-9f19-a88900a403d8 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state rescued and task_state unrescuing.
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for 776b71c1-6696-4575-9c0d-e9340af62167 due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892056.3308241, 776b71c1-6696-4575-9c0d-e9340af62167 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:14:16 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] VM Resumed (Lifecycle Event)
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-daad8f71-9e71-4826-ad51-fb0132f67ece tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:14:16 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892056.3322985, 776b71c1-6696-4575-9c0d-e9340af62167 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:14:16 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] VM Started (Lifecycle Event)
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:14:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:17 user nova-compute[72178]: INFO nova.compute.manager [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Detaching volume 5fef2f7b-68d3-47cb-b6db-c8a04172da54
Aug 01 12:14:17 user nova-compute[72178]: INFO nova.virt.block_device [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attempting to driver detach volume 5fef2f7b-68d3-47cb-b6db-c8a04172da54 from mountpoint /dev/vdb
Aug 01 12:14:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Attempting to detach device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:14:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:14:17 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:14:17 user nova-compute[72178]:   <source dev="/dev/sdi"/>
Aug 01 12:14:17 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:14:17 user nova-compute[72178]:   <serial>5fef2f7b-68d3-47cb-b6db-c8a04172da54</serial>
Aug 01 12:14:17 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:14:17 user nova-compute[72178]: </disk>
Aug 01 12:14:17 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:14:17 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully detached device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the persistent domain config.
Aug 01 12:14:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:14:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:14:17 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:14:17 user nova-compute[72178]:   <source dev="/dev/sdi"/>
Aug 01 12:14:17 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:14:17 user nova-compute[72178]:   <serial>5fef2f7b-68d3-47cb-b6db-c8a04172da54</serial>
Aug 01 12:14:17 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:14:17 user nova-compute[72178]: </disk>
Aug 01 12:14:17 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:14:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892058.2212582, febae49f-2d0b-4f28-a695-0ecaaf120077 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:14:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully detached device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the live domain config.
Aug 01 12:14:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eQwjiZsL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:14:18 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4cb179-ee34-4ad8-91ed-87d88ca12fe7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c8c49e-68c5-46f6-8bdb-0562d6a56903]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 (non-flash)
Aug 01 12:14:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d425c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54'): ({'sdi'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Removing single pathed devices sdi {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da6d1af-39ad-429b-be4c-9d41c7e48c95]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4e846d-a599-41bd-aea9-b870f5e21708]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Flushing IO for device /dev/sdi {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc6b1df-101f-40f0-b0a0-0f8c6adbfde2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b95242-13fb-4d21-94b0-1cad71ace570]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] SCSI volumes sdi have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[539b171e-2469-46ca-bb2a-1a2cd0c3e587]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3c3dc4-647d-4466-8fee-e8b23dba3794]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54, portal: 172.16.0.220,3260]
Aug 01 12:14:18 user nova-compute[72178]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54, portal: 172.16.0.220,3260] successful.
Aug 01 12:14:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5fef2f7b-68d3-47cb-b6db-c8a04172da54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd43a6-e188-44c0-b905-cf7e3a35b684]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== disconnect_volume: return (335ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:14:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:14:19 user nova-compute[72178]: DEBUG nova.objects.instance [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-56147ed6-4379-4dd0-a554-16d9610e25e3 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.694s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:20 user nova-compute[72178]: INFO nova.compute.manager [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Terminating instance
Aug 01 12:14:20 user nova-compute[72178]: DEBUG nova.compute.manager [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-fea2f4bc-265e-43c8-b98a-8b0b837c40b1 req-dc8ec804-9d50-4a69-abc4-07e15fda9db3 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-unplugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fea2f4bc-265e-43c8-b98a-8b0b837c40b1 req-dc8ec804-9d50-4a69-abc4-07e15fda9db3 service nova] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fea2f4bc-265e-43c8-b98a-8b0b837c40b1 req-dc8ec804-9d50-4a69-abc4-07e15fda9db3 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fea2f4bc-265e-43c8-b98a-8b0b837c40b1 req-dc8ec804-9d50-4a69-abc4-07e15fda9db3 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-fea2f4bc-265e-43c8-b98a-8b0b837c40b1 req-dc8ec804-9d50-4a69-abc4-07e15fda9db3 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] No waiting events found dispatching network-vif-unplugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-fea2f4bc-265e-43c8-b98a-8b0b837c40b1 req-dc8ec804-9d50-4a69-abc4-07e15fda9db3 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-unplugged-29efbfad-3acd-4d72-977a-776ed80c3b47 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Instance destroyed successfully.
Aug 01 12:14:21 user nova-compute[72178]: DEBUG nova.objects.instance [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'resources' on Instance uuid e7e1d3fe-99fe-41fe-bff7-5ea191c529de {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-83603559',display_name='tempest-ServerActionsTestOtherA-server-83603559',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-83603559',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:09:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-4nops17y',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=e7e1d3fe-99fe-41fe-bff7-5ea191c529de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "29efbfad-3acd-4d72-977a-776ed80c3b47", "address": "fa:16:3e:be:52:74", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29efbfad-3a", "ovs_interfaceid": "29efbfad-3acd-4d72-977a-776ed80c3b47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_vif [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29efbfad-3a, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:14:21 user nova-compute[72178]: INFO os_vif [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:52:74,bridge_name='br-int',has_traffic_filtering=True,id=29efbfad-3acd-4d72-977a-776ed80c3b47,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29efbfad-3a')
Aug 01 12:14:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nXWOLGuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:14:21 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[44281efe-803b-4d3b-986b-3856c6ff1caa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b249d270-26f0-4fbf-a65a-2585f57b8037]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:21 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:21 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:21 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f4364c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2cb68d-0dc1-41be-b261-1f786f0f5ba6]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[067f106c-1b61-4ad6-992c-5b735b455e1b]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[526b9d68-8ede-4a1c-bab4-548cdd87df26]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f358b6-050e-462e-af4d-4c8ab1815337]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[180e294e-93ce-41e6-bd51-42dba8250983]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e914be94-498f-4b63-84e0-45a779462804]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260]
Aug 01 12:14:21 user nova-compute[72178]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987, portal: 172.16.0.220,3260] successful.
Aug 01 12:14:21 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64be150-ec55-4d6d-bd76-b493ac7c871f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] <== disconnect_volume: return (359ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:14:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Deleting instance files /opt/stack/data/nova/instances/e7e1d3fe-99fe-41fe-bff7-5ea191c529de_del
Aug 01 12:14:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Deletion of /opt/stack/data/nova/instances/e7e1d3fe-99fe-41fe-bff7-5ea191c529de_del complete
Aug 01 12:14:21 user nova-compute[72178]: INFO nova.compute.manager [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 01 12:14:21 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:14:21 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:14:22 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:22 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Took 0.89 seconds to deallocate network for instance.
Aug 01 12:14:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-08d20394-1c22-4f46-9778-b11465a41a8a req-59902f44-d5bb-425e-982f-5ec989542e53 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-deleted-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-d93d876d-b37f-41e6-a37f-1b9182a3dc91 req-8b554bbf-0b45-4000-bbaa-6249dbad88c7 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d93d876d-b37f-41e6-a37f-1b9182a3dc91 req-8b554bbf-0b45-4000-bbaa-6249dbad88c7 service nova] Acquiring lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d93d876d-b37f-41e6-a37f-1b9182a3dc91 req-8b554bbf-0b45-4000-bbaa-6249dbad88c7 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d93d876d-b37f-41e6-a37f-1b9182a3dc91 req-8b554bbf-0b45-4000-bbaa-6249dbad88c7 service nova] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-d93d876d-b37f-41e6-a37f-1b9182a3dc91 req-8b554bbf-0b45-4000-bbaa-6249dbad88c7 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] No waiting events found dispatching network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:22 user nova-compute[72178]: WARNING nova.compute.manager [req-d93d876d-b37f-41e6-a37f-1b9182a3dc91 req-8b554bbf-0b45-4000-bbaa-6249dbad88c7 service nova] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Received unexpected event network-vif-plugged-29efbfad-3acd-4d72-977a-776ed80c3b47 for instance with vm_state active and task_state deleting.
Aug 01 12:14:23 user nova-compute[72178]: INFO nova.compute.manager [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 12:14:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Deleting volume: 1aaa80a6-89bc-4172-bdd7-6f6ab3e17987 {{(pid=72178) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 12:14:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:23 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:14:23 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:14:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:23 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Deleted allocations for instance e7e1d3fe-99fe-41fe-bff7-5ea191c529de
Aug 01 12:14:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-98dda926-89a8-4439-a9a0-d641771c8c71 tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "e7e1d3fe-99fe-41fe-bff7-5ea191c529de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.628s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-7a07e01b-4b14-4bfb-b4e4-f10155f9a78e req-2f4d506b-e171-4b73-8efe-26ab61a7fde1 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-7a07e01b-4b14-4bfb-b4e4-f10155f9a78e req-2f4d506b-e171-4b73-8efe-26ab61a7fde1 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing instance network info cache due to event network-changed-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7a07e01b-4b14-4bfb-b4e4-f10155f9a78e req-2f4d506b-e171-4b73-8efe-26ab61a7fde1 service nova] Acquiring lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7a07e01b-4b14-4bfb-b4e4-f10155f9a78e req-2f4d506b-e171-4b73-8efe-26ab61a7fde1 service nova] Acquired lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG nova.network.neutron [req-7a07e01b-4b14-4bfb-b4e4-f10155f9a78e req-2f4d506b-e171-4b73-8efe-26ab61a7fde1 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Refreshing network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:29 user nova-compute[72178]: INFO nova.compute.manager [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Terminating instance
Aug 01 12:14:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:30 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Instance destroyed successfully.
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lazy-loading 'resources' on Instance uuid c2b7b3b8-1ed3-4754-9699-16839c7394c7 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T12:08:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1328072652',display_name='tempest-TestShelveInstance-server-1328072652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1328072652',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwjwe2NdthKjiiiDi8LPsHxZ0tDKDs/9Uun1Ww17FDngKtnc7NvmGm3AznOcjSbg9LqkomceEK+3+pVvsZSqMdN7zaprPelRi8gxSWDIdFhuk2cLYa22E7aX89S4/oyPg==',key_name='tempest-TestShelveInstance-619818221',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='729b625630fd4a26ba76891d65a5f5bc',ramdisk_id='',reservation_id='r-2737bifb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-297202234',owner_user_name='tempest-TestShelveInstance-297202234-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:13:03Z,user_data=None,user_id='192962f272724516b92bb7c10add101b',uuid=c2b7b3b8-1ed3-4754-9699-16839c7394c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converting VIF {"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_vif [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee85ca88-4f, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:14:30 user nova-compute[72178]: INFO os_vif [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:63:db,bridge_name='br-int',has_traffic_filtering=True,id=ee85ca88-4f2e-40c5-aca3-d3114cd5c03a,network=Network(432964e0-23c7-42bd-ace7-a248210e5486),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee85ca88-4f')
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUfTGMXR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:14:30 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c323c5-aabe-45ad-a95d-4a69daf9cbb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade58fe-ffd0-4f83-9d44-76d0af140de5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 (non-flash)
Aug 01 12:14:30 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040ca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0'): ({'sdh'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Removing single pathed devices sdh {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[155df57a-fa03-4c12-9578-4c70d7fcd918]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7330104-0ea2-4df4-8dc6-f61f5fccbf4d]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Flushing IO for device /dev/sdh {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc2eda4-80d0-4ed0-a317-632cf841c95a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a503baf2-d214-47f7-b20f-10d36fed3ae0]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] SCSI volumes sdh have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1587d378-08e17959fa9755cb', '/dev/disk/by-id/scsi-23038653137393539', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1587d378') {{(pid=83857) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc40e82e-6dd6-4f19-8a82-6679b38f4aff]: (4, None) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-712ed245-0031-411c-a391-965184db3750 req-072b772f-d6ee-45bb-b0f5-0c13cca23463 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-unplugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-712ed245-0031-411c-a391-965184db3750 req-072b772f-d6ee-45bb-b0f5-0c13cca23463 service nova] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-712ed245-0031-411c-a391-965184db3750 req-072b772f-d6ee-45bb-b0f5-0c13cca23463 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-712ed245-0031-411c-a391-965184db3750 req-072b772f-d6ee-45bb-b0f5-0c13cca23463 service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-712ed245-0031-411c-a391-965184db3750 req-072b772f-d6ee-45bb-b0f5-0c13cca23463 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] No waiting events found dispatching network-vif-unplugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.compute.manager [req-712ed245-0031-411c-a391-965184db3750 req-072b772f-d6ee-45bb-b0f5-0c13cca23463 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-unplugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff63d9a5-3578-4d7c-865d-770169161a07]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f564b-718a-4795-99bd-a6667ec83f70]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260]
Aug 01 12:14:30 user nova-compute[72178]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0, portal: 172.16.0.220,3260] successful.
Aug 01 12:14:30 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa4dbd87-fe59-416b-ac59-b2d3fc287be0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cb8f84-724d-4e0e-9cbf-87d4d8a73227]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] <== disconnect_volume: return (342ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:14:30 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Deleting instance files /opt/stack/data/nova/instances/c2b7b3b8-1ed3-4754-9699-16839c7394c7_del
Aug 01 12:14:30 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Deletion of /opt/stack/data/nova/instances/c2b7b3b8-1ed3-4754-9699-16839c7394c7_del complete
Aug 01 12:14:30 user nova-compute[72178]: INFO nova.compute.manager [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.network.neutron [req-7a07e01b-4b14-4bfb-b4e4-f10155f9a78e req-2f4d506b-e171-4b73-8efe-26ab61a7fde1 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updated VIF entry in instance network info cache for port ee85ca88-4f2e-40c5-aca3-d3114cd5c03a. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG nova.network.neutron [req-7a07e01b-4b14-4bfb-b4e4-f10155f9a78e req-2f4d506b-e171-4b73-8efe-26ab61a7fde1 service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [{"id": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "address": "fa:16:3e:dc:63:db", "network": {"id": "432964e0-23c7-42bd-ace7-a248210e5486", "bridge": "br-int", "label": "tempest-TestShelveInstance-1148287977-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "729b625630fd4a26ba76891d65a5f5bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee85ca88-4f", "ovs_interfaceid": "ee85ca88-4f2e-40c5-aca3-d3114cd5c03a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7a07e01b-4b14-4bfb-b4e4-f10155f9a78e req-2f4d506b-e171-4b73-8efe-26ab61a7fde1 service nova] Releasing lock "refresh_cache-c2b7b3b8-1ed3-4754-9699-16839c7394c7" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:31 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Took 0.60 seconds to deallocate network for instance.
Aug 01 12:14:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:31 user nova-compute[72178]: INFO nova.compute.manager [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Terminating instance
Aug 01 12:14:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-448d43ab-429c-4db8-90be-f6f1ef8c36bd req-5566890e-3a57-4853-9f86-243f5cae2027 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-448d43ab-429c-4db8-90be-f6f1ef8c36bd req-5566890e-3a57-4853-9f86-243f5cae2027 service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-448d43ab-429c-4db8-90be-f6f1ef8c36bd req-5566890e-3a57-4853-9f86-243f5cae2027 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-448d43ab-429c-4db8-90be-f6f1ef8c36bd req-5566890e-3a57-4853-9f86-243f5cae2027 service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-448d43ab-429c-4db8-90be-f6f1ef8c36bd req-5566890e-3a57-4853-9f86-243f5cae2027 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-448d43ab-429c-4db8-90be-f6f1ef8c36bd req-5566890e-3a57-4853-9f86-243f5cae2027 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-unplugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:14:31 user nova-compute[72178]: INFO nova.compute.manager [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Took 0.74 seconds to detach 1 volumes for instance.
Aug 01 12:14:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Deleting volume: fa4dbd87-fe59-416b-ac59-b2d3fc287be0 {{(pid=72178) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:32 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Instance destroyed successfully.
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lazy-loading 'resources' on Instance uuid 8ac32412-1f05-4d62-a184-0b90f1b3d21c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1723458725',display_name='tempest-ServerRescueNegativeTestJSON-server-1723458725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1723458725',id=2,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:03:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee85194306f544e8be7c1a8d2ba4656c',ramdisk_id='',reservation_id='r-rmm0o2wt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1377634293',owner_user_name='tempest-ServerRescueNegativeTestJSON-1377634293-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:05:32Z,user_data=None,user_id='6f27c80bc14843e6a250f1df6e40f26f',uuid=8ac32412-1f05-4d62-a184-0b90f1b3d21c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converting VIF {"id": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "address": "fa:16:3e:fc:7a:b7", "network": {"id": "d632b891-4cf7-4056-8f2b-22c01de2cad3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-981150473-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee85194306f544e8be7c1a8d2ba4656c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d37f04c-d3", "ovs_interfaceid": "1d37f04c-d365-4720-ace0-73d2cdd79af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:7a:b7,bridge_name='br-int',has_traffic_filtering=True,id=1d37f04c-d365-4720-ace0-73d2cdd79af2,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d37f04c-d3') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG os_vif [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:7a:b7,bridge_name='br-int',has_traffic_filtering=True,id=1d37f04c-d365-4720-ace0-73d2cdd79af2,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d37f04c-d3') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d37f04c-d3, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:14:32 user nova-compute[72178]: INFO os_vif [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:7a:b7,bridge_name='br-int',has_traffic_filtering=True,id=1d37f04c-d365-4720-ace0-73d2cdd79af2,network=Network(d632b891-4cf7-4056-8f2b-22c01de2cad3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d37f04c-d3')
Aug 01 12:14:32 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Deleting instance files /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c_del
Aug 01 12:14:32 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Deletion of /opt/stack/data/nova/instances/8ac32412-1f05-4d62-a184-0b90f1b3d21c_del complete
Aug 01 12:14:32 user nova-compute[72178]: INFO nova.compute.manager [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1236e79f-6a11-4f79-b790-5afbc7bd92f1 req-b1148d0a-c180-4460-9214-4522e8a1270d service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1236e79f-6a11-4f79-b790-5afbc7bd92f1 req-b1148d0a-c180-4460-9214-4522e8a1270d service nova] Acquiring lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1236e79f-6a11-4f79-b790-5afbc7bd92f1 req-b1148d0a-c180-4460-9214-4522e8a1270d service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1236e79f-6a11-4f79-b790-5afbc7bd92f1 req-b1148d0a-c180-4460-9214-4522e8a1270d service nova] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1236e79f-6a11-4f79-b790-5afbc7bd92f1 req-b1148d0a-c180-4460-9214-4522e8a1270d service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] No waiting events found dispatching network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:32 user nova-compute[72178]: WARNING nova.compute.manager [req-1236e79f-6a11-4f79-b790-5afbc7bd92f1 req-b1148d0a-c180-4460-9214-4522e8a1270d service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received unexpected event network-vif-plugged-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a for instance with vm_state deleted and task_state None.
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-1236e79f-6a11-4f79-b790-5afbc7bd92f1 req-b1148d0a-c180-4460-9214-4522e8a1270d service nova] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Received event network-vif-deleted-ee85ca88-4f2e-40c5-aca3-d3114cd5c03a {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:32 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Deleted allocations for instance c2b7b3b8-1ed3-4754-9699-16839c7394c7
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c05b8dc9-3ee7-410d-a48a-1a41ec376e2b tempest-TestShelveInstance-297202234 tempest-TestShelveInstance-297202234-project-member] Lock "c2b7b3b8-1ed3-4754-9699-16839c7394c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.291s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:32 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Took 0.47 seconds to deallocate network for instance.
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:33 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:14:33 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:14:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:33 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Deleted allocations for instance 8ac32412-1f05-4d62-a184-0b90f1b3d21c
Aug 01 12:14:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6b09f40d-3d02-4d8c-8922-8cdcc9a6f52f tempest-ServerRescueNegativeTestJSON-1377634293 tempest-ServerRescueNegativeTestJSON-1377634293-project-member] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.758s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9fa0f97-141f-4a7a-bd52-44987d62089c req-f5a09224-335b-41eb-8f2b-9eebb8402f5c service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9fa0f97-141f-4a7a-bd52-44987d62089c req-f5a09224-335b-41eb-8f2b-9eebb8402f5c service nova] Acquiring lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9fa0f97-141f-4a7a-bd52-44987d62089c req-f5a09224-335b-41eb-8f2b-9eebb8402f5c service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c9fa0f97-141f-4a7a-bd52-44987d62089c req-f5a09224-335b-41eb-8f2b-9eebb8402f5c service nova] Lock "8ac32412-1f05-4d62-a184-0b90f1b3d21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-c9fa0f97-141f-4a7a-bd52-44987d62089c req-f5a09224-335b-41eb-8f2b-9eebb8402f5c service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] No waiting events found dispatching network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:34 user nova-compute[72178]: WARNING nova.compute.manager [req-c9fa0f97-141f-4a7a-bd52-44987d62089c req-f5a09224-335b-41eb-8f2b-9eebb8402f5c service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received unexpected event network-vif-plugged-1d37f04c-d365-4720-ace0-73d2cdd79af2 for instance with vm_state deleted and task_state None.
Aug 01 12:14:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-daec21c8-0726-4256-bda8-7d4e98cb157c req-031f7afc-40f8-4d46-9a49-ea87765ea636 service nova] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Received event network-vif-deleted-1d37f04c-d365-4720-ace0-73d2cdd79af2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:36 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892061.1338, e7e1d3fe-99fe-41fe-bff7-5ea191c529de => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:14:36 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] VM Stopped (Lifecycle Event)
Aug 01 12:14:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ebda9d25-f689-4db8-a420-77fefa4d5b3c None None] [instance: e7e1d3fe-99fe-41fe-bff7-5ea191c529de] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:14:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:36 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:14:36 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [{"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-84869969-6058-4000-808e-7ccb4ea10aa9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:14:37 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:14:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:37 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'flavor' on Instance uuid c4621d07-791b-49da-97b3-aa8558914e7b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:39 user nova-compute[72178]: INFO nova.compute.manager [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Attaching volume 1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 to /dev/vdb
Aug 01 12:14:39 user nova-compute[72178]: DEBUG os_brick.utils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[31102885-d4fb-4022-969c-b64264ea27c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f83ac0-9f18-405c-b668-e327b656bdac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99844a3-c017-4bca-b696-9a12331477ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37a52b8-d12c-426b-ba04-95b40a2078fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:14:39 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:14:39 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c08fcf-009f-4928-95fc-200da45092a7]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG os_brick.utils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:14:39 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating existing volume attachment record: 02cfb529-506f-482b-af84-3a07875c673f {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:44 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:14:44 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=6909MB free_disk=25.00225067138672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 84869969-6058-4000-808e-7ccb4ea10aa9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 776b71c1-6696-4575-9c0d-e9340af62167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance febae49f-2d0b-4f28-a695-0ecaaf120077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance be40c1ae-0b3e-43c6-804b-ce8158b49233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d6ab7d82-da92-460f-9172-b635d396513e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance c4621d07-791b-49da-97b3-aa8558914e7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 8567b676-68ad-4869-8c32-babff84c347b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 155adc09-065e-425b-8573-7b1be9aa030b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:14:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:45 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892070.1592085, c2b7b3b8-1ed3-4754-9699-16839c7394c7 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:14:45 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] VM Stopped (Lifecycle Event)
Aug 01 12:14:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9ab7ae5d-7889-4c59-bec6-e767090f58d1 None None] [instance: c2b7b3b8-1ed3-4754-9699-16839c7394c7] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892072.2424157, 8ac32412-1f05-4d62-a184-0b90f1b3d21c => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:14:47 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] VM Stopped (Lifecycle Event)
Aug 01 12:14:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-36b145cb-4a51-4f36-aa2d-a793b08415ea None None] [instance: 8ac32412-1f05-4d62-a184-0b90f1b3d21c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXPMytni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:14:47 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:14:47 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:14:47 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[86be2745-02a9-42b0-b335-9bf37ac0f6ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:14:47 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b68e3d-a74e-4321-88f0-9f034b759f89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0] added
Aug 01 12:14:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895ce24-c1a6-409d-b6eb-b2d7d269a476]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddddee5-97d0-4139-8f6d-1b3814766e9a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXPMytni {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXPMytni" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c9436a-9948-40dd-902b-0a368cb7bfa5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXPMytni'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[693ad2a4-1ca2-459d-9458-a92d92e1e2f9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[893ad6f9-a2cc-4c23-861b-10ac73a9a022]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6178c5f-8fbc-476a-a7b3-e8e7b09fc8a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0, portal: 172.16.0.220,3260]
Aug 01 12:14:47 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0, portal: 172.16.0.220,3260] successful.
Aug 01 12:14:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.062s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d5756a-32e8-4be8-9f2c-36ab3973cbe5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ae1b8-18fb-48f6-a786-3348a49376b2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:14:47 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[564404ab-f07f-493e-8641-f1be95fdaea6]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:47 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=72178) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXPMytni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26437663638383131', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:14:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437663638383131', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'flavor' on Instance uuid c4621d07-791b-49da-97b3-aa8558914e7b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:14:49 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:14:49 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:14:49 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:14:49 user nova-compute[72178]:   <serial>1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0</serial>
Aug 01 12:14:49 user nova-compute[72178]: </disk>
Aug 01 12:14:49 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:14:49 user nova-compute[72178]: INFO nova.compute.claims [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Claim successful on node user
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] No VIF found with MAC fa:16:3e:1c:b7:43, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9a586991-3783-45d3-ba9d-21742dba4f44 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.763s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:14:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:14:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Creating image(s)
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "/opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "/opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG nova.policy [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec07389bdd7847469b8376941948997c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e82a73d8a1944928b14ff263f3a2d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk 1073741824" returned: 0 in 0.118s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Cannot resize image /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lazy-loading 'migration_context' on Instance uuid f3a2f566-6844-403b-bdba-b9ad4e0a9d6f {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Ensure instance console log exists: /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Successfully created port: 37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-59f872c3-4492-4f47-9f68-46b7c813951c req-5ecb05cd-4b6e-4be0-a92c-34f1a7d342a6 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-changed-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG nova.compute.manager [req-59f872c3-4492-4f47-9f68-46b7c813951c req-5ecb05cd-4b6e-4be0-a92c-34f1a7d342a6 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Refreshing instance network info cache due to event network-changed-c58015ad-87f2-4b34-8754-b64d3e65440c. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-59f872c3-4492-4f47-9f68-46b7c813951c req-5ecb05cd-4b6e-4be0-a92c-34f1a7d342a6 service nova] Acquiring lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-59f872c3-4492-4f47-9f68-46b7c813951c req-5ecb05cd-4b6e-4be0-a92c-34f1a7d342a6 service nova] Acquired lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG nova.network.neutron [req-59f872c3-4492-4f47-9f68-46b7c813951c req-5ecb05cd-4b6e-4be0-a92c-34f1a7d342a6 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Refreshing network info cache for port c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] There are 0 instances to clean {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "8567b676-68ad-4869-8c32-babff84c347b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "8567b676-68ad-4869-8c32-babff84c347b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "8567b676-68ad-4869-8c32-babff84c347b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:51 user nova-compute[72178]: INFO nova.compute.manager [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Terminating instance
Aug 01 12:14:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Instance destroyed successfully.
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'resources' on Instance uuid 8567b676-68ad-4869-8c32-babff84c347b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1990855850',display_name='tempest-AttachVolumeNegativeTest-server-1990855850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1990855850',id=34,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoWNMHX8ToTiy7Wd04Vb5j2AWL0SQzjgWvp41dU7EyiLU9MGjgLXlSugJ1Hgi57p/GEX99sndiHgaZoPNqrXbKo15ZDj8l4ZkvBGZi9NBISz9DqoYuZP3R/n9MC2OKrSA==',key_name='tempest-keypair-1450729308',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-i0jcsu45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:13:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=8567b676-68ad-4869-8c32-babff84c347b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:14,bridge_name='br-int',has_traffic_filtering=True,id=c58015ad-87f2-4b34-8754-b64d3e65440c,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58015ad-87') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG os_vif [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:14,bridge_name='br-int',has_traffic_filtering=True,id=c58015ad-87f2-4b34-8754-b64d3e65440c,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58015ad-87') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc58015ad-87, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:14:52 user nova-compute[72178]: INFO os_vif [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6a:14,bridge_name='br-int',has_traffic_filtering=True,id=c58015ad-87f2-4b34-8754-b64d3e65440c,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc58015ad-87')
Aug 01 12:14:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Deleting instance files /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b_del
Aug 01 12:14:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Deletion of /opt/stack/data/nova/instances/8567b676-68ad-4869-8c32-babff84c347b_del complete
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: INFO nova.compute.manager [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 12:14:52 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 8567b676-68ad-4869-8c32-babff84c347b] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.network.neutron [req-59f872c3-4492-4f47-9f68-46b7c813951c req-5ecb05cd-4b6e-4be0-a92c-34f1a7d342a6 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Updated VIF entry in instance network info cache for port c58015ad-87f2-4b34-8754-b64d3e65440c. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.network.neutron [req-59f872c3-4492-4f47-9f68-46b7c813951c req-5ecb05cd-4b6e-4be0-a92c-34f1a7d342a6 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Updating instance_info_cache with network_info: [{"id": "c58015ad-87f2-4b34-8754-b64d3e65440c", "address": "fa:16:3e:bc:6a:14", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc58015ad-87", "ovs_interfaceid": "c58015ad-87f2-4b34-8754-b64d3e65440c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-59f872c3-4492-4f47-9f68-46b7c813951c req-5ecb05cd-4b6e-4be0-a92c-34f1a7d342a6 service nova] Releasing lock "refresh_cache-8567b676-68ad-4869-8c32-babff84c347b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-03288df1-f1c4-45dd-8d58-178f3f91ee75 req-04f308f7-65d3-4255-a884-a55e217cb4a5 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-03288df1-f1c4-45dd-8d58-178f3f91ee75 req-04f308f7-65d3-4255-a884-a55e217cb4a5 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing instance network info cache due to event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-03288df1-f1c4-45dd-8d58-178f3f91ee75 req-04f308f7-65d3-4255-a884-a55e217cb4a5 service nova] Acquiring lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-03288df1-f1c4-45dd-8d58-178f3f91ee75 req-04f308f7-65d3-4255-a884-a55e217cb4a5 service nova] Acquired lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:52 user nova-compute[72178]: DEBUG nova.network.neutron [req-03288df1-f1c4-45dd-8d58-178f3f91ee75 req-04f308f7-65d3-4255-a884-a55e217cb4a5 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:14:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-919e1a63-6780-4aa6-91e6-c945bbd47208 req-9835680c-585f-4c23-a42b-f35aa53cbaff service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-vif-unplugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-919e1a63-6780-4aa6-91e6-c945bbd47208 req-9835680c-585f-4c23-a42b-f35aa53cbaff service nova] Acquiring lock "8567b676-68ad-4869-8c32-babff84c347b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-919e1a63-6780-4aa6-91e6-c945bbd47208 req-9835680c-585f-4c23-a42b-f35aa53cbaff service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-919e1a63-6780-4aa6-91e6-c945bbd47208 req-9835680c-585f-4c23-a42b-f35aa53cbaff service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-919e1a63-6780-4aa6-91e6-c945bbd47208 req-9835680c-585f-4c23-a42b-f35aa53cbaff service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] No waiting events found dispatching network-vif-unplugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-919e1a63-6780-4aa6-91e6-c945bbd47208 req-9835680c-585f-4c23-a42b-f35aa53cbaff service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-vif-unplugged-c58015ad-87f2-4b34-8754-b64d3e65440c for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:14:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Successfully updated port: 37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:14:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "refresh_cache-f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquired lock "refresh_cache-f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:14:54 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:14:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-03288df1-f1c4-45dd-8d58-178f3f91ee75 req-04f308f7-65d3-4255-a884-a55e217cb4a5 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updated VIF entry in instance network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:14:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-03288df1-f1c4-45dd-8d58-178f3f91ee75 req-04f308f7-65d3-4255-a884-a55e217cb4a5 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-03288df1-f1c4-45dd-8d58-178f3f91ee75 req-04f308f7-65d3-4255-a884-a55e217cb4a5 service nova] Releasing lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Acquiring lock "8567b676-68ad-4869-8c32-babff84c347b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] No waiting events found dispatching network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:55 user nova-compute[72178]: WARNING nova.compute.manager [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received unexpected event network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c for instance with vm_state active and task_state deleting.
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received event network-changed-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Refreshing instance network info cache due to event network-changed-37bd9edf-6b78-4f33-a23d-d17f8685de51. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Acquiring lock "refresh_cache-f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:55 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Took 2.97 seconds to deallocate network for instance.
Aug 01 12:14:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Updating instance_info_cache with network_info: [{"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Releasing lock "refresh_cache-f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Instance network_info: |[{"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Acquired lock "refresh_cache-f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.network.neutron [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Refreshing network info cache for port 37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Start _get_guest_xml network_info=[{"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:14:55 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:14:55 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-301316349',display_name='tempest-VolumesActionsTest-instance-301316349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-301316349',id=37,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e82a73d8a1944928b14ff263f3a2d385',ramdisk_id='',reservation_id='r-qxdqui90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-439234941',owner_user_name='tempest-VolumesActionsTest-439234941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:14:50Z,user_data=None,user_id='ec07389bdd7847469b8376941948997c',uuid=f3a2f566-6844-403b-bdba-b9ad4e0a9d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converting VIF {"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8c:1d,bridge_name='br-int',has_traffic_filtering=True,id=37bd9edf-6b78-4f33-a23d-d17f8685de51,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bd9edf-6b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lazy-loading 'pci_devices' on Instance uuid f3a2f566-6844-403b-bdba-b9ad4e0a9d6f {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:14:55 user nova-compute[72178]:   <uuid>f3a2f566-6844-403b-bdba-b9ad4e0a9d6f</uuid>
Aug 01 12:14:55 user nova-compute[72178]:   <name>instance-00000025</name>
Aug 01 12:14:55 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:14:55 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:14:55 user nova-compute[72178]:   <metadata>
Aug 01 12:14:55 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:14:55 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:14:55 user nova-compute[72178]:       <nova:name>tempest-VolumesActionsTest-instance-301316349</nova:name>
Aug 01 12:14:55 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:14:55</nova:creationTime>
Aug 01 12:14:55 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:14:55 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:14:55 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:14:55 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:14:55 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:14:55 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:14:55 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:14:55 user nova-compute[72178]:       <nova:owner>
Aug 01 12:14:55 user nova-compute[72178]:         <nova:user uuid="ec07389bdd7847469b8376941948997c">tempest-VolumesActionsTest-439234941-project-member</nova:user>
Aug 01 12:14:55 user nova-compute[72178]:         <nova:project uuid="e82a73d8a1944928b14ff263f3a2d385">tempest-VolumesActionsTest-439234941</nova:project>
Aug 01 12:14:55 user nova-compute[72178]:       </nova:owner>
Aug 01 12:14:55 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:14:55 user nova-compute[72178]:       <nova:ports>
Aug 01 12:14:55 user nova-compute[72178]:         <nova:port uuid="37bd9edf-6b78-4f33-a23d-d17f8685de51">
Aug 01 12:14:55 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 12:14:55 user nova-compute[72178]:         </nova:port>
Aug 01 12:14:55 user nova-compute[72178]:       </nova:ports>
Aug 01 12:14:55 user nova-compute[72178]:     </nova:instance>
Aug 01 12:14:55 user nova-compute[72178]:   </metadata>
Aug 01 12:14:55 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:14:55 user nova-compute[72178]:     <system>
Aug 01 12:14:55 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:14:55 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:14:55 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:14:55 user nova-compute[72178]:       <entry name="serial">f3a2f566-6844-403b-bdba-b9ad4e0a9d6f</entry>
Aug 01 12:14:55 user nova-compute[72178]:       <entry name="uuid">f3a2f566-6844-403b-bdba-b9ad4e0a9d6f</entry>
Aug 01 12:14:55 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:14:55 user nova-compute[72178]:     </system>
Aug 01 12:14:55 user nova-compute[72178]:   </sysinfo>
Aug 01 12:14:55 user nova-compute[72178]:   <os>
Aug 01 12:14:55 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:14:55 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:14:55 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:14:55 user nova-compute[72178]:   </os>
Aug 01 12:14:55 user nova-compute[72178]:   <features>
Aug 01 12:14:55 user nova-compute[72178]:     <acpi/>
Aug 01 12:14:55 user nova-compute[72178]:     <apic/>
Aug 01 12:14:55 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:14:55 user nova-compute[72178]:   </features>
Aug 01 12:14:55 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:14:55 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:14:55 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:14:55 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:14:55 user nova-compute[72178]:   </clock>
Aug 01 12:14:55 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:14:55 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:14:55 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:14:55 user nova-compute[72178]:   </cpu>
Aug 01 12:14:55 user nova-compute[72178]:   <devices>
Aug 01 12:14:55 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:14:55 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:14:55 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk"/>
Aug 01 12:14:55 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:14:55 user nova-compute[72178]:     </disk>
Aug 01 12:14:55 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:14:55 user nova-compute[72178]:       <mac address="fa:16:3e:2f:8c:1d"/>
Aug 01 12:14:55 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:14:55 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:14:55 user nova-compute[72178]:       <target dev="tap37bd9edf-6b"/>
Aug 01 12:14:55 user nova-compute[72178]:     </interface>
Aug 01 12:14:55 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:14:55 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/console.log" append="off"/>
Aug 01 12:14:55 user nova-compute[72178]:     </serial>
Aug 01 12:14:55 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:14:55 user nova-compute[72178]:     <video>
Aug 01 12:14:55 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:14:55 user nova-compute[72178]:     </video>
Aug 01 12:14:55 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:14:55 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:14:55 user nova-compute[72178]:     </rng>
Aug 01 12:14:55 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:14:55 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:14:55 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:14:55 user nova-compute[72178]:     </memballoon>
Aug 01 12:14:55 user nova-compute[72178]:   </devices>
Aug 01 12:14:55 user nova-compute[72178]: </domain>
Aug 01 12:14:55 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-301316349',display_name='tempest-VolumesActionsTest-instance-301316349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-301316349',id=37,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e82a73d8a1944928b14ff263f3a2d385',ramdisk_id='',reservation_id='r-qxdqui90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-439234941',owner_user_name='tempest-VolumesActionsTest-439234941-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:14:50Z,user_data=None,user_id='ec07389bdd7847469b8376941948997c',uuid=f3a2f566-6844-403b-bdba-b9ad4e0a9d6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converting VIF {"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8c:1d,bridge_name='br-int',has_traffic_filtering=True,id=37bd9edf-6b78-4f33-a23d-d17f8685de51,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bd9edf-6b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG os_vif [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8c:1d,bridge_name='br-int',has_traffic_filtering=True,id=37bd9edf-6b78-4f33-a23d-d17f8685de51,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bd9edf-6b') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37bd9edf-6b, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37bd9edf-6b, col_values=(('external_ids', {'iface-id': '37bd9edf-6b78-4f33-a23d-d17f8685de51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:8c:1d', 'vm-uuid': 'f3a2f566-6844-403b-bdba-b9ad4e0a9d6f'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:55 user nova-compute[72178]: INFO os_vif [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8c:1d,bridge_name='br-int',has_traffic_filtering=True,id=37bd9edf-6b78-4f33-a23d-d17f8685de51,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bd9edf-6b')
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] No VIF found with MAC fa:16:3e:2f:8c:1d, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:14:55 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:56 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Deleted allocations for instance 8567b676-68ad-4869-8c32-babff84c347b
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-440ec0b9-9d79-4e4f-a110-09d3b08e048b tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "8567b676-68ad-4869-8c32-babff84c347b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.596s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG nova.network.neutron [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Updated VIF entry in instance network info cache for port 37bd9edf-6b78-4f33-a23d-d17f8685de51. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG nova.network.neutron [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Updating instance_info_cache with network_info: [{"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Releasing lock "refresh_cache-f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Acquiring lock "8567b676-68ad-4869-8c32-babff84c347b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] Lock "8567b676-68ad-4869-8c32-babff84c347b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG nova.compute.manager [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] No waiting events found dispatching network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:56 user nova-compute[72178]: WARNING nova.compute.manager [req-5e121c43-1a22-4435-98e8-dee5f41a4479 req-61367c33-98e3-49ca-aa28-8b2fded6f079 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received unexpected event network-vif-plugged-c58015ad-87f2-4b34-8754-b64d3e65440c for instance with vm_state active and task_state deleting.
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:56 user nova-compute[72178]: INFO nova.compute.manager [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Rebooting instance
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquired lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Received event network-vif-deleted-c58015ad-87f2-4b34-8754-b64d3e65440c {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing instance network info cache due to event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] Acquiring lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-2c2845f8-f7f9-4b9b-b0d8-5579a26b7751 req-41a6736a-3a3c-4418-b49a-a527a98bfdd3 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received event network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2c2845f8-f7f9-4b9b-b0d8-5579a26b7751 req-41a6736a-3a3c-4418-b49a-a527a98bfdd3 service nova] Acquiring lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2c2845f8-f7f9-4b9b-b0d8-5579a26b7751 req-41a6736a-3a3c-4418-b49a-a527a98bfdd3 service nova] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2c2845f8-f7f9-4b9b-b0d8-5579a26b7751 req-41a6736a-3a3c-4418-b49a-a527a98bfdd3 service nova] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-2c2845f8-f7f9-4b9b-b0d8-5579a26b7751 req-41a6736a-3a3c-4418-b49a-a527a98bfdd3 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] No waiting events found dispatching network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:57 user nova-compute[72178]: WARNING nova.compute.manager [req-2c2845f8-f7f9-4b9b-b0d8-5579a26b7751 req-41a6736a-3a3c-4418-b49a-a527a98bfdd3 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received unexpected event network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 for instance with vm_state building and task_state spawning.
Aug 01 12:14:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Releasing lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] Acquired lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:14:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updated VIF entry in instance network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee1817f4-6113-4539-99d4-942c6c073452 req-aa784865-01a4-4374-b347-7bd00fa71fb2 service nova] Releasing lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-82a13a3e-d96a-4008-af1d-0846725f5610 req-ecc6334a-04dd-4318-a0bf-211609f2ddc0 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received event network-changed-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG nova.compute.manager [req-82a13a3e-d96a-4008-af1d-0846725f5610 req-ecc6334a-04dd-4318-a0bf-211609f2ddc0 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Refreshing instance network info cache due to event network-changed-15719805-083a-4bd0-b4cf-1860e29883d7. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-82a13a3e-d96a-4008-af1d-0846725f5610 req-ecc6334a-04dd-4318-a0bf-211609f2ddc0 service nova] Acquiring lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-82a13a3e-d96a-4008-af1d-0846725f5610 req-ecc6334a-04dd-4318-a0bf-211609f2ddc0 service nova] Acquired lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-82a13a3e-d96a-4008-af1d-0846725f5610 req-ecc6334a-04dd-4318-a0bf-211609f2ddc0 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Refreshing network info cache for port 15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-82a13a3e-d96a-4008-af1d-0846725f5610 req-ecc6334a-04dd-4318-a0bf-211609f2ddc0 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Updated VIF entry in instance network info cache for port 15719805-083a-4bd0-b4cf-1860e29883d7. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-82a13a3e-d96a-4008-af1d-0846725f5610 req-ecc6334a-04dd-4318-a0bf-211609f2ddc0 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Updating instance_info_cache with network_info: [{"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-82a13a3e-d96a-4008-af1d-0846725f5610 req-ecc6334a-04dd-4318-a0bf-211609f2ddc0 service nova] Releasing lock "refresh_cache-155adc09-065e-425b-8573-7b1be9aa030b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "155adc09-065e-425b-8573-7b1be9aa030b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "155adc09-065e-425b-8573-7b1be9aa030b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "155adc09-065e-425b-8573-7b1be9aa030b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:58 user nova-compute[72178]: INFO nova.compute.manager [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Terminating instance
Aug 01 12:14:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Instance destroyed successfully.
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.objects.instance [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'resources' on Instance uuid 155adc09-065e-425b-8573-7b1be9aa030b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2138167455',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2138167455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2138167455',id=35,image_ref='e323a4e0-b861-433b-afc9-6348c4d9d324',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClvwM6CD3sV12gNUdZ2Kw64Eeaco3tlIZFGTtRXpf0jJhhI0bpefa7Qy05tgv8EXZVmQ9bBE19fEgyXC4RQ3FuOFpJZTV2evGkWzgc61JUTT0CZxmAsKJTCQF3O4jzkCA==',key_name='tempest-keypair-1988468850',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-0crqhl06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1003407750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:13:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=155adc09-065e-425b-8573-7b1be9aa030b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "15719805-083a-4bd0-b4cf-1860e29883d7", "address": "fa:16:3e:9d:79:e6", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15719805-08", "ovs_interfaceid": "15719805-083a-4bd0-b4cf-1860e29883d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:79:e6,bridge_name='br-int',has_traffic_filtering=True,id=15719805-083a-4bd0-b4cf-1860e29883d7,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15719805-08') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_vif [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:79:e6,bridge_name='br-int',has_traffic_filtering=True,id=15719805-083a-4bd0-b4cf-1860e29883d7,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15719805-08') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15719805-08, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:14:59 user nova-compute[72178]: INFO os_vif [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:79:e6,bridge_name='br-int',has_traffic_filtering=True,id=15719805-083a-4bd0-b4cf-1860e29883d7,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15719805-08')
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CpQbmfPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:14:59 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4c664d-6815-4b28-b510-1120cd4c24e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e496a7-f1df-44ac-8271-c55e91610f7e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:14:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 (non-flash)
Aug 01 12:14:59 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:14:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f8d98040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554'): ({'sdf'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Removing single pathed devices sdf {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca54b70-6b57-42db-94ef-8fd6c7941c04]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892099.5756586, f3a2f566-6844-403b-bdba-b9ad4e0a9d6f => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] VM Resumed (Lifecycle Event)
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd5722b-eb0f-4ecc-b7d2-6edbac350b15]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flushing IO for device /dev/sdf {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Instance spawned successfully.
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[16011ec5-d418-4b1e-969a-77e3bbbdd9a7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892099.5765946, f3a2f566-6844-403b-bdba-b9ad4e0a9d6f => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] VM Started (Lifecycle Event)
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-98bcbe6e-1d64-4fec-be41-4eb4fd809c79 req-22dd2e76-118d-404f-9565-0e356ce7f79f service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received event network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-98bcbe6e-1d64-4fec-be41-4eb4fd809c79 req-22dd2e76-118d-404f-9565-0e356ce7f79f service nova] Acquiring lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-98bcbe6e-1d64-4fec-be41-4eb4fd809c79 req-22dd2e76-118d-404f-9565-0e356ce7f79f service nova] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-98bcbe6e-1d64-4fec-be41-4eb4fd809c79 req-22dd2e76-118d-404f-9565-0e356ce7f79f service nova] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-98bcbe6e-1d64-4fec-be41-4eb4fd809c79 req-22dd2e76-118d-404f-9565-0e356ce7f79f service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] No waiting events found dispatching network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:14:59 user nova-compute[72178]: WARNING nova.compute.manager [req-98bcbe6e-1d64-4fec-be41-4eb4fd809c79 req-22dd2e76-118d-404f-9565-0e356ce7f79f service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received unexpected event network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 for instance with vm_state building and task_state spawning.
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18c8a9-6fca-48b5-acc3-4269f6f5de1a]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.106s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd1230d-658d-4f7f-8d75-044c9481367b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Took 10.10 seconds to spawn the instance on the hypervisor.
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bc4fd8-8426-481f-9810-92a60f4bd22d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554, portal: 172.16.0.220,3260]
Aug 01 12:14:59 user nova-compute[72178]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554, portal: 172.16.0.220,3260] successful.
Aug 01 12:14:59 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ede5fb4-4c22-42ad-a16d-48c522e2f554 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb78633-ab85-4f78-8fef-655bc18709b3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.compute.manager [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Took 10.84 seconds to build instance.
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== disconnect_volume: return (439ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Deleting instance files /opt/stack/data/nova/instances/155adc09-065e-425b-8573-7b1be9aa030b_del
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Deletion of /opt/stack/data/nova/instances/155adc09-065e-425b-8573-7b1be9aa030b_del complete
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b54149ed-4e53-4e57-92e0-e4e74c8c1387 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.930s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:14:59 user nova-compute[72178]: INFO nova.compute.manager [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 01 12:14:59 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:14:59 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received event network-vif-unplugged-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] Acquiring lock "155adc09-065e-425b-8573-7b1be9aa030b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] No waiting events found dispatching network-vif-unplugged-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received event network-vif-unplugged-15719805-083a-4bd0-b4cf-1860e29883d7 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received event network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] Acquiring lock "155adc09-065e-425b-8573-7b1be9aa030b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] Lock "155adc09-065e-425b-8573-7b1be9aa030b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] No waiting events found dispatching network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:00 user nova-compute[72178]: WARNING nova.compute.manager [req-f7abefe0-dbdd-474b-84e0-83e397d5c3cc req-3f5e6a34-f0e4-4559-837e-3d29c37c5aa6 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received unexpected event network-vif-plugged-15719805-083a-4bd0-b4cf-1860e29883d7 for instance with vm_state active and task_state deleting.
Aug 01 12:15:00 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Instance shutdown successfully.
Aug 01 12:15:01 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:15:01 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Took 1.14 seconds to deallocate network for instance.
Aug 01 12:15:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-d63f73b0-7eb6-48cb-8b89-b762c6ea81a5 req-0078fdb3-2559-4153-8254-e02ae2e0cee6 service nova] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Received event network-vif-deleted-15719805-083a-4bd0-b4cf-1860e29883d7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:02 user nova-compute[72178]: INFO nova.compute.manager [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Took 0.96 seconds to detach 1 volumes for instance.
Aug 01 12:15:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Deleting volume: 0ede5fb4-4c22-42ad-a16d-48c522e2f554 {{(pid=72178) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-unplugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] No waiting events found dispatching network-vif-unplugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:02 user nova-compute[72178]: WARNING nova.compute.manager [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received unexpected event network-vif-unplugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e for instance with vm_state active and task_state reboot_started.
Aug 01 12:15:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] No waiting events found dispatching network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:02 user nova-compute[72178]: WARNING nova.compute.manager [req-d99ff283-b89a-4d31-b2d1-95246eb5c72c req-b9871076-dd1d-4669-aee0-f043bfe5682e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received unexpected event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e for instance with vm_state active and task_state reboot_started.
Aug 01 12:15:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:15:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.623s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:02 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Deleted allocations for instance 155adc09-065e-425b-8573-7b1be9aa030b
Aug 01 12:15:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-441cc2fd-0d5c-4f54-8af1-74619063fafc tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "155adc09-065e-425b-8573-7b1be9aa030b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.417s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] No waiting events found dispatching network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:04 user nova-compute[72178]: WARNING nova.compute.manager [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received unexpected event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e for instance with vm_state active and task_state reboot_started.
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] No waiting events found dispatching network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:04 user nova-compute[72178]: WARNING nova.compute.manager [req-2136989a-dd01-48d6-ae5c-e9ade6f5a23e req-846a6e7f-dae2-4688-80a5-fe19aae4db7e service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received unexpected event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e for instance with vm_state active and task_state reboot_started.
Aug 01 12:15:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Removed pending event for c4621d07-791b-49da-97b3-aa8558914e7b due to event {{(pid=72178) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892104.896143, c4621d07-791b-49da-97b3-aa8558914e7b => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:15:04 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] VM Resumed (Lifecycle Event)
Aug 01 12:15:04 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Instance running successfully.
Aug 01 12:15:04 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Instance soft rebooted successfully.
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:15:04 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892104.897054, c4621d07-791b-49da-97b3-aa8558914e7b => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:15:04 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] VM Started (Lifecycle Event)
Aug 01 12:15:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4bce465f-ccf2-4603-90bc-7c4333745029 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.065s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:15:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-150a8b32-cbf4-4cf7-bc8c-2d9b2af19304 req-edbe0e34-a89b-4e98-80fe-009630ccb0ae service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-changed-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-150a8b32-cbf4-4cf7-bc8c-2d9b2af19304 req-edbe0e34-a89b-4e98-80fe-009630ccb0ae service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Refreshing instance network info cache due to event network-changed-e15e122f-e600-4d15-a508-998a84817013. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:15:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-150a8b32-cbf4-4cf7-bc8c-2d9b2af19304 req-edbe0e34-a89b-4e98-80fe-009630ccb0ae service nova] Acquiring lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:15:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-150a8b32-cbf4-4cf7-bc8c-2d9b2af19304 req-edbe0e34-a89b-4e98-80fe-009630ccb0ae service nova] Acquired lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:15:06 user nova-compute[72178]: DEBUG nova.network.neutron [req-150a8b32-cbf4-4cf7-bc8c-2d9b2af19304 req-edbe0e34-a89b-4e98-80fe-009630ccb0ae service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Refreshing network info cache for port e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:15:07 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892092.4095094, 8567b676-68ad-4869-8c32-babff84c347b => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:15:07 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 8567b676-68ad-4869-8c32-babff84c347b] VM Stopped (Lifecycle Event)
Aug 01 12:15:07 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aa172e91-c4dd-4f36-94ab-6f336786dd2c None None] [instance: 8567b676-68ad-4869-8c32-babff84c347b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:07 user nova-compute[72178]: DEBUG nova.network.neutron [req-150a8b32-cbf4-4cf7-bc8c-2d9b2af19304 req-edbe0e34-a89b-4e98-80fe-009630ccb0ae service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updated VIF entry in instance network info cache for port e15e122f-e600-4d15-a508-998a84817013. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:15:07 user nova-compute[72178]: DEBUG nova.network.neutron [req-150a8b32-cbf4-4cf7-bc8c-2d9b2af19304 req-edbe0e34-a89b-4e98-80fe-009630ccb0ae service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:15:07 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-150a8b32-cbf4-4cf7-bc8c-2d9b2af19304 req-edbe0e34-a89b-4e98-80fe-009630ccb0ae service nova] Releasing lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:15:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:10 user nova-compute[72178]: DEBUG nova.objects.instance [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:10 user nova-compute[72178]: INFO nova.compute.manager [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Attaching volume 99579ea8-a988-4a66-bd52-c38d5d003d34 to /dev/vdb
Aug 01 12:15:11 user nova-compute[72178]: DEBUG os_brick.utils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d2de16-7fe5-4ad8-9c24-8e76a1035eea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[36681449-39a7-4410-b079-b6d230d8af88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba9ffc3-e107-446c-96b4-ab2808f250c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaa8fce-75cc-4c5f-bb42-62df73b1e390]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:15:11 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cef071-c948-4b2f-b96c-0d38313fb941]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG os_brick.utils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating existing volume attachment record: 50b42eaf-2153-4bf3-9b92-ea87bfc3c8e5 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:12 user nova-compute[72178]: INFO nova.compute.manager [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attaching volume eb60b7d5-69e8-4b38-817c-ee975740bd00 to /dev/vdb
Aug 01 12:15:12 user nova-compute[72178]: DEBUG os_brick.utils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d8054b-65e6-4d02-aa97-e4700627d6c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a804e963-6e30-47b4-a831-f941b38fb178]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd54db6-0b46-4c5e-a703-274ebd102deb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a866f92-8f74-4677-8332-13340d6a4bd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:15:12 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:15:12 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caad65d-b804-43be-9b64-2866788f1504]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG os_brick.utils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:15:12 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating existing volume attachment record: c3d2c7d9-b895-4074-9e1c-a2b6545b9b83 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:15:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:14 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892099.4249876, 155adc09-065e-425b-8573-7b1be9aa030b => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:15:14 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] VM Stopped (Lifecycle Event)
Aug 01 12:15:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-549b03a9-04c4-4eac-a402-423d253a4528 None None] [instance: 155adc09-065e-425b-8573-7b1be9aa030b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:15 user nova-compute[72178]: INFO nova.compute.manager [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Terminating instance
Aug 01 12:15:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee40c487-24e3-4f1d-b8e4-97e22a144858 req-2c8b4519-6c54-49da-8076-8d6e9545261e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-unplugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee40c487-24e3-4f1d-b8e4-97e22a144858 req-2c8b4519-6c54-49da-8076-8d6e9545261e service nova] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee40c487-24e3-4f1d-b8e4-97e22a144858 req-2c8b4519-6c54-49da-8076-8d6e9545261e service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ee40c487-24e3-4f1d-b8e4-97e22a144858 req-2c8b4519-6c54-49da-8076-8d6e9545261e service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee40c487-24e3-4f1d-b8e4-97e22a144858 req-2c8b4519-6c54-49da-8076-8d6e9545261e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] No waiting events found dispatching network-vif-unplugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-ee40c487-24e3-4f1d-b8e4-97e22a144858 req-2c8b4519-6c54-49da-8076-8d6e9545261e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-unplugged-326dc903-e97e-4cde-bd42-5145785c4f92 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:15:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Instance destroyed successfully.
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.objects.instance [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lazy-loading 'resources' on Instance uuid 84869969-6058-4000-808e-7ccb4ea10aa9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-01T11:58:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2025863266',display_name='tempest-ServerActionsTestOtherA-server-951071372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2025863266',id=3,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGo+VqN1qvlbehHSgQHO5djy2DEfW6gvHkIMQVrkl+aLuOfO0ynuyl9NLx2rWwN3x9z+kNv9BWnpdCHzQ2m/UFB3r2KZnvGUe7mpuKvqh+cYTMF+cz6duEpEHtjCUC+iqQ==',key_name='tempest-keypair-1970173127',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:03:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4c619872deb42eca689576a995b252e',ramdisk_id='',reservation_id='r-a1thrv1z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-709464081',owner_user_name='tempest-ServerActionsTestOtherA-709464081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5bc4265e5e5a4c50b76f755a048af7b4',uuid=84869969-6058-4000-808e-7ccb4ea10aa9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converting VIF {"id": "326dc903-e97e-4cde-bd42-5145785c4f92", "address": "fa:16:3e:1a:f9:b8", "network": {"id": "4f6e68d9-ac0c-4130-a29e-a45733374459", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-407065071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4c619872deb42eca689576a995b252e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap326dc903-e9", "ovs_interfaceid": "326dc903-e97e-4cde-bd42-5145785c4f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG os_vif [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap326dc903-e9, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:16 user nova-compute[72178]: INFO os_vif [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:f9:b8,bridge_name='br-int',has_traffic_filtering=True,id=326dc903-e97e-4cde-bd42-5145785c4f92,network=Network(4f6e68d9-ac0c-4130-a29e-a45733374459),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap326dc903-e9')
Aug 01 12:15:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Deleting instance files /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9_del
Aug 01 12:15:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Deletion of /opt/stack/data/nova/instances/84869969-6058-4000-808e-7ccb4ea10aa9_del complete
Aug 01 12:15:16 user nova-compute[72178]: INFO nova.compute.manager [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 01 12:15:16 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:15:16 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:15:17 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Took 0.64 seconds to deallocate network for instance.
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-ce003970-90a2-4627-935f-605ef6835107 req-8f419de9-fde1-4d79-b275-e5236a67977e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-deleted-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:17 user nova-compute[72178]: INFO nova.compute.manager [req-ce003970-90a2-4627-935f-605ef6835107 req-8f419de9-fde1-4d79-b275-e5236a67977e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Neutron deleted interface 326dc903-e97e-4cde-bd42-5145785c4f92; detaching it from the instance and deleting it from the info cache
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-ce003970-90a2-4627-935f-605ef6835107 req-8f419de9-fde1-4d79-b275-e5236a67977e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-ce003970-90a2-4627-935f-605ef6835107 req-8f419de9-fde1-4d79-b275-e5236a67977e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Detach interface failed, port_id=326dc903-e97e-4cde-bd42-5145785c4f92, reason: Instance 84869969-6058-4000-808e-7ccb4ea10aa9 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Refreshing inventories for resource provider f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Updating ProviderTree inventory for provider f106307e-ff81-42a0-bae9-51f40c919103 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Refreshing aggregate associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, aggregates: None {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Refreshing trait associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:15:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.665s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:17 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Deleted allocations for instance 84869969-6058-4000-808e-7ccb4ea10aa9
Aug 01 12:15:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-40cfe6eb-efd7-4181-b177-343672a05f2d tempest-ServerActionsTestOtherA-709464081 tempest-ServerActionsTestOtherA-709464081-project-member] Lock "84869969-6058-4000-808e-7ccb4ea10aa9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.497s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-6200f830-04a9-4a3d-9498-8ac8b3eb5f82 req-8506412e-88e0-49a3-8acc-e9f4c60b811e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6200f830-04a9-4a3d-9498-8ac8b3eb5f82 req-8506412e-88e0-49a3-8acc-e9f4c60b811e service nova] Acquiring lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6200f830-04a9-4a3d-9498-8ac8b3eb5f82 req-8506412e-88e0-49a3-8acc-e9f4c60b811e service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6200f830-04a9-4a3d-9498-8ac8b3eb5f82 req-8506412e-88e0-49a3-8acc-e9f4c60b811e service nova] Lock "84869969-6058-4000-808e-7ccb4ea10aa9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-6200f830-04a9-4a3d-9498-8ac8b3eb5f82 req-8506412e-88e0-49a3-8acc-e9f4c60b811e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] No waiting events found dispatching network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:18 user nova-compute[72178]: WARNING nova.compute.manager [req-6200f830-04a9-4a3d-9498-8ac8b3eb5f82 req-8506412e-88e0-49a3-8acc-e9f4c60b811e service nova] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Received unexpected event network-vif-plugged-326dc903-e97e-4cde-bd42-5145785c4f92 for instance with vm_state deleted and task_state None.
Aug 01 12:15:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGIhgKQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:15:20 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:15:20 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:15:20 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[557f68b0-cc8a-4bd8-8c1e-70300e97b692]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:15:20 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4399367a-da91-4697-8ebd-69d7f79769a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00] added
Aug 01 12:15:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[47addc23-dec5-4d44-b8c9-2790de480c76]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ab9b0-4452-4254-a3b3-ff9ddafe6355]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AGIhgKQM {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AGIhgKQM" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7888af13-0bb1-41e8-9587-170bc797d37d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AGIhgKQM'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[181bd724-1c8e-43ca-8b63-28975d1b5472]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7fff63-3ee2-455b-afbc-938b86c31aac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabd4260-ae9a-4d57-8851-fcbc7d95a416]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00, portal: 172.16.0.220,3260]
Aug 01 12:15:20 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00, portal: 172.16.0.220,3260] successful.
Aug 01 12:15:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[742457d9-a170-4237-adc5-ce1389a686b0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[be60a980-f24d-458f-90d5-bb3fb03acfd8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)
Aug 01 12:15:20 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1e0a86-9059-4e23-9f26-a9e253b532cc]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:15:20 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGIhgKQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:15:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:15:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26332653838633033', 'path': '/dev/sdf'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:15:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332653838633033', 'path': '/dev/sdf'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:15:21 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:15:21 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:15:21 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:15:21 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:15:21 user nova-compute[72178]:   <serial>eb60b7d5-69e8-4b38-817c-ee975740bd00</serial>
Aug 01 12:15:21 user nova-compute[72178]: </disk>
Aug 01 12:15:21 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:15:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:15:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:15:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No VIF found with MAC fa:16:3e:d2:93:c8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:15:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bd67e9da-091c-47de-8a0d-635f8a8af2ea tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.271s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwUSojVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:15:23 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:15:23 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:15:23 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[22782b85-c192-4cae-b39a-7b9618ea7fa7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:15:23 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[befaa4fb-dbf5-4086-b390-3fd0bb6fd746]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34] added
Aug 01 12:15:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec6211c-6744-4731-a5fc-a4a98b5115fb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b41a82a-d15a-4c63-8247-b224b9f116e1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwUSojVE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwUSojVE" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cb876e-3af8-4c26-ae46-e8ac4b2fe637]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mwUSojVE'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b724b44-c114-4f13-8fe6-f82ee1b4b7ef]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6736d5-c0c4-4227-9833-d70335b49cab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c6d28f-bf5d-4ff9-b45d-2dff2b377f0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260]
Aug 01 12:15:23 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260] successful.
Aug 01 12:15:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d9c5ca-263d-401c-9eec-9a8dce193f58]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d0ddb3-ea61-47ce-9ae2-f2c4d1038252]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:15:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] HCTL ('39', '-', '-', 0) found on session 42 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d526ed2-b692-4c5f-b92d-673d50b4fc59]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching for a device in session 42 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:15:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwUSojVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23837353130333035', 'path': '/dev/sdh'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837353130333035', 'path': '/dev/sdh'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:24 user nova-compute[72178]: INFO nova.compute.manager [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Detaching volume eb60b7d5-69e8-4b38-817c-ee975740bd00
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:15:24 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:15:24 user nova-compute[72178]:   <source dev="/dev/sdh"/>
Aug 01 12:15:24 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:15:24 user nova-compute[72178]:   <serial>99579ea8-a988-4a66-bd52-c38d5d003d34</serial>
Aug 01 12:15:24 user nova-compute[72178]: </disk>
Aug 01 12:15:24 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:15:24 user nova-compute[72178]: INFO nova.virt.block_device [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attempting to driver detach volume eb60b7d5-69e8-4b38-817c-ee975740bd00 from mountpoint /dev/vdb
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Attempting to detach device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:15:24 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:15:24 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:15:24 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:15:24 user nova-compute[72178]:   <serial>eb60b7d5-69e8-4b38-817c-ee975740bd00</serial>
Aug 01 12:15:24 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:15:24 user nova-compute[72178]: </disk>
Aug 01 12:15:24 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:15:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully detached device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the persistent domain config.
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:15:24 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:15:24 user nova-compute[72178]:   <source dev="/dev/sdf"/>
Aug 01 12:15:24 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:15:24 user nova-compute[72178]:   <serial>eb60b7d5-69e8-4b38-817c-ee975740bd00</serial>
Aug 01 12:15:24 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:15:24 user nova-compute[72178]: </disk>
Aug 01 12:15:24 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:15:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No VIF found with MAC fa:16:3e:de:3e:66, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1a92a6e9-9e99-435d-b536-0cee49b2af0e tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.126s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892125.179093, febae49f-2d0b-4f28-a695-0ecaaf120077 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:15:25 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully detached device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the live domain config.
Aug 01 12:15:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AGIhgKQM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:15:25 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[258df8ef-d571-4d70-a955-8fb49d095947]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac18be1-2f93-4d50-8991-f25edacd62ab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:15:25 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 (non-flash)
Aug 01 12:15:25 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:15:25 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d425ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00'): ({'sdf'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Removing single pathed devices sdf {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f37033-fc2c-470e-ab0d-7c3efcc6e757]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[571b6a10-32e3-4db1-b6ca-d411daca47d4]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Flushing IO for device /dev/sdf {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc41285-8e2d-43b1-9033-ed3a546a5347]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b527dc6-a1f8-4ca0-b878-0f88fcebec6a]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] SCSI volumes sdf have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ec46c4-c484-44dd-a96d-12119eddeef8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7da6a71-d0a7-4755-b155-2297c682bcfe]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00, portal: 172.16.0.220,3260]
Aug 01 12:15:25 user nova-compute[72178]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00, portal: 172.16.0.220,3260] successful.
Aug 01 12:15:25 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb60b7d5-69e8-4b38-817c-ee975740bd00 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4124149e-626a-4238-ae48-2480daac6fa7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== disconnect_volume: return (333ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:15:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcbf9d88-ebae-42f5-8a14-b8fdaa049f67 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcbf9d88-ebae-42f5-8a14-b8fdaa049f67 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcbf9d88-ebae-42f5-8a14-b8fdaa049f67 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcbf9d88-ebae-42f5-8a14-b8fdaa049f67 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72178) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bcbf9d88-ebae-42f5-8a14-b8fdaa049f67 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG nova.objects.instance [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-188d0e36-84df-4a6a-860c-e705c936a200 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.898s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG nova.compute.manager [req-0876ad06-9e47-4ece-a808-6ea15705b658 req-5bfad129-f59c-49fb-a1b1-040a071d3b24 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0876ad06-9e47-4ece-a808-6ea15705b658 req-5bfad129-f59c-49fb-a1b1-040a071d3b24 service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0876ad06-9e47-4ece-a808-6ea15705b658 req-5bfad129-f59c-49fb-a1b1-040a071d3b24 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0876ad06-9e47-4ece-a808-6ea15705b658 req-5bfad129-f59c-49fb-a1b1-040a071d3b24 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:26 user nova-compute[72178]: DEBUG nova.compute.manager [req-0876ad06-9e47-4ece-a808-6ea15705b658 req-5bfad129-f59c-49fb-a1b1-040a071d3b24 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:26 user nova-compute[72178]: WARNING nova.compute.manager [req-0876ad06-9e47-4ece-a808-6ea15705b658 req-5bfad129-f59c-49fb-a1b1-040a071d3b24 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state active and task_state powering-off.
Aug 01 12:15:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance destroyed successfully.
Aug 01 12:15:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcbf9d88-ebae-42f5-8a14-b8fdaa049f67 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcbf9d88-ebae-42f5-8a14-b8fdaa049f67 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.887s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-c1f0dfc3-126d-4366-9af9-052d3c3c2c2e req-a9eab13d-e4a5-46c1-bc17-22cf9d36cf4a service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c1f0dfc3-126d-4366-9af9-052d3c3c2c2e req-a9eab13d-e4a5-46c1-bc17-22cf9d36cf4a service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c1f0dfc3-126d-4366-9af9-052d3c3c2c2e req-a9eab13d-e4a5-46c1-bc17-22cf9d36cf4a service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c1f0dfc3-126d-4366-9af9-052d3c3c2c2e req-a9eab13d-e4a5-46c1-bc17-22cf9d36cf4a service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-c1f0dfc3-126d-4366-9af9-052d3c3c2c2e req-a9eab13d-e4a5-46c1-bc17-22cf9d36cf4a service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:29 user nova-compute[72178]: WARNING nova.compute.manager [req-c1f0dfc3-126d-4366-9af9-052d3c3c2c2e req-a9eab13d-e4a5-46c1-bc17-22cf9d36cf4a service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state stopped and task_state None.
Aug 01 12:15:31 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892116.3873818, 84869969-6058-4000-808e-7ccb4ea10aa9 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:15:31 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] VM Stopped (Lifecycle Event)
Aug 01 12:15:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-4099f514-dc56-4128-a253-ed96a857d74b None None] [instance: 84869969-6058-4000-808e-7ccb4ea10aa9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:36 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:15:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_power_states {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 5f720460-477f-472a-904b-7a8c82bca76e {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 004ce11d-31dc-41dc-a5ac-b639c4c8486d {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid be40c1ae-0b3e-43c6-804b-ce8158b49233 {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid d6ab7d82-da92-460f-9172-b635d396513e {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid c4621d07-791b-49da-97b3-aa8558914e7b {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid f3a2f566-6844-403b-bdba-b9ad4e0a9d6f {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "5f720460-477f-472a-904b-7a8c82bca76e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.005s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "776b71c1-6696-4575-9c0d-e9340af62167" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "d6ab7d82-da92-460f-9172-b635d396513e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "d6ab7d82-da92-460f-9172-b635d396513e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "5f720460-477f-472a-904b-7a8c82bca76e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "776b71c1-6696-4575-9c0d-e9340af62167" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "d6ab7d82-da92-460f-9172-b635d396513e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:38 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:15:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:15:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:15:38 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:15:39 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updating instance_info_cache with network_info: [{"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:15:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-5f720460-477f-472a-904b-7a8c82bca76e" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:15:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:15:39 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:42 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892127.0435553, 6c816328-61df-4625-95e6-bc27fbd7148d => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:15:42 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Stopped (Lifecycle Event)
Aug 01 12:15:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a2cbb3bf-4e67-48c6-8ae3-4112411d3f70 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:15:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a2cbb3bf-4e67-48c6-8ae3-4112411d3f70 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:15:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:44 user nova-compute[72178]: INFO nova.compute.manager [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Detaching volume 514b0098-ca04-4346-9ccf-086d8e5f23b2
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: INFO nova.virt.block_device [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Attempting to driver detach volume 514b0098-ca04-4346-9ccf-086d8e5f23b2 from mountpoint /dev/vdb
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Attempting to detach device vdb from instance be40c1ae-0b3e-43c6-804b-ce8158b49233 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:15:44 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:15:44 user nova-compute[72178]:   <source dev="/dev/sdg"/>
Aug 01 12:15:44 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:15:44 user nova-compute[72178]:   <serial>514b0098-ca04-4346-9ccf-086d8e5f23b2</serial>
Aug 01 12:15:44 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:15:44 user nova-compute[72178]: </disk>
Aug 01 12:15:44 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:15:44 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully detached device vdb from instance be40c1ae-0b3e-43c6-804b-ce8158b49233 from the persistent domain config.
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be40c1ae-0b3e-43c6-804b-ce8158b49233 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:15:44 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:15:44 user nova-compute[72178]:   <source dev="/dev/sdg"/>
Aug 01 12:15:44 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:15:44 user nova-compute[72178]:   <serial>514b0098-ca04-4346-9ccf-086d8e5f23b2</serial>
Aug 01 12:15:44 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:15:44 user nova-compute[72178]: </disk>
Aug 01 12:15:44 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892144.7425873, be40c1ae-0b3e-43c6-804b-ce8158b49233 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be40c1ae-0b3e-43c6-804b-ce8158b49233 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:15:44 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully detached device vdb from instance be40c1ae-0b3e-43c6-804b-ce8158b49233 from the live domain config.
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Mgjwturp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:15:44 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efcb2f1-7e46-4d0f-aae4-a81caa2ed82a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6031ec3b-4e58-4469-be1a-527b7634857b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:15:44 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:44 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:15:44 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f41d5510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2'): ({'sdg'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Removing single pathed devices sdg {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c23d426-70b5-49c6-ae36-5ec9aa0e4b1b]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d4e0e8-293f-4673-aaa4-0f642bf70101]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flushing IO for device /dev/sdg {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[251a21cf-fa45-4ed1-99ff-9137436df635]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aabf6c6-4ea8-423f-b614-6c45867b6245]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] SCSI volumes sdg have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[67479706-dd59-4a08-8cb2-f222d58ced9e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6c4ca3-2d0d-46b8-8aed-b646559806df]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2, portal: 172.16.0.220,3260]
Aug 01 12:15:45 user nova-compute[72178]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2, portal: 172.16.0.220,3260] successful.
Aug 01 12:15:45 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:514b0098-ca04-4346-9ccf-086d8e5f23b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f244bfcc-83e0-4a3c-9cac-01e574bd11a7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== disconnect_volume: return (357ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG nova.objects.instance [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid be40c1ae-0b3e-43c6-804b-ce8158b49233 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-df6f5388-26d0-4d55-ae23-97a2cd5ca6f9 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.296s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:46 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:15:46 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7501MB free_disk=25.000080108642578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 776b71c1-6696-4575-9c0d-e9340af62167 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance febae49f-2d0b-4f28-a695-0ecaaf120077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance be40c1ae-0b3e-43c6-804b-ce8158b49233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d6ab7d82-da92-460f-9172-b635d396513e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance c4621d07-791b-49da-97b3-aa8558914e7b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f3a2f566-6844-403b-bdba-b9ad4e0a9d6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:15:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "d6ab7d82-da92-460f-9172-b635d396513e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "d6ab7d82-da92-460f-9172-b635d396513e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "d6ab7d82-da92-460f-9172-b635d396513e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:52 user nova-compute[72178]: INFO nova.compute.manager [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Terminating instance
Aug 01 12:15:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-a44c0afd-4a0d-4513-8021-66c8d2abb954 req-81c9a2b1-1dbc-41d3-aa76-ec37eb902f33 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received event network-vif-unplugged-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a44c0afd-4a0d-4513-8021-66c8d2abb954 req-81c9a2b1-1dbc-41d3-aa76-ec37eb902f33 service nova] Acquiring lock "d6ab7d82-da92-460f-9172-b635d396513e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a44c0afd-4a0d-4513-8021-66c8d2abb954 req-81c9a2b1-1dbc-41d3-aa76-ec37eb902f33 service nova] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a44c0afd-4a0d-4513-8021-66c8d2abb954 req-81c9a2b1-1dbc-41d3-aa76-ec37eb902f33 service nova] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-a44c0afd-4a0d-4513-8021-66c8d2abb954 req-81c9a2b1-1dbc-41d3-aa76-ec37eb902f33 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] No waiting events found dispatching network-vif-unplugged-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-a44c0afd-4a0d-4513-8021-66c8d2abb954 req-81c9a2b1-1dbc-41d3-aa76-ec37eb902f33 service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received event network-vif-unplugged-a424854f-d402-47c0-952b-f405b7e31c4e for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:15:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Instance destroyed successfully.
Aug 01 12:15:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'resources' on Instance uuid d6ab7d82-da92-460f-9172-b635d396513e {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:11:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1393913398',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1393913398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1393913398',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZIbnDKilIJ0qHQWjTpwmP1uzL5R2d7x19G/uW58QgYv9zs5QhDzFx5BdZOGOcgBtWVMb4txS8PlVXG14vfyNqfOrhHmzVGrt4nNxzKGCZ/Y0qnWiEPKrIeHuuXwLAviA==',key_name='tempest-keypair-268238054',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:11:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-ihg4tp8j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=d6ab7d82-da92-460f-9172-b635d396513e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "a424854f-d402-47c0-952b-f405b7e31c4e", "address": "fa:16:3e:a6:4c:28", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa424854f-d4", "ovs_interfaceid": "a424854f-d402-47c0-952b-f405b7e31c4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:4c:28,bridge_name='br-int',has_traffic_filtering=True,id=a424854f-d402-47c0-952b-f405b7e31c4e,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa424854f-d4') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_vif [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:4c:28,bridge_name='br-int',has_traffic_filtering=True,id=a424854f-d402-47c0-952b-f405b7e31c4e,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa424854f-d4') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa424854f-d4, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:15:53 user nova-compute[72178]: INFO os_vif [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:4c:28,bridge_name='br-int',has_traffic_filtering=True,id=a424854f-d402-47c0-952b-f405b7e31c4e,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa424854f-d4')
Aug 01 12:15:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LJHGvYkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:15:53 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d912aa88-09cc-49cb-9a18-1c5d34b06dd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b388c7-fd03-46de-a188-6c64db91055f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:53 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:53 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:53 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:53 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:15:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:15:53 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:15:53 user nova-compute[72178]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e (non-flash)
Aug 01 12:15:53 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:15:53 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:15:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f453d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e'): ({'sde'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Removing single pathed devices sde {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6de9bad-a90b-4a86-b59e-7f5d84db9d90]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[10036765-ad04-43df-a78a-b8ae51f3b90b]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flushing IO for device /dev/sde {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bcbf7f-1b17-49b2-8a20-82f54e1e73bf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.127s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3888c266-07b0-4aee-bf0c-0e4c4c32ae2c]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] SCSI volumes sde have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc921bb8-ab1f-4345-9c08-3fb34b113947]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[44904818-4aad-486c-bcbe-b967ecdb1c61]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e, portal: 172.16.0.220,3260]
Aug 01 12:15:53 user nova-compute[72178]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e, portal: 172.16.0.220,3260] successful.
Aug 01 12:15:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:354f73e0-5d66-4d03-acd9-e4f286fa0e3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08554be-65a4-42c7-bf36-2e104991f38e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== disconnect_volume: return (383ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:15:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Deleting instance files /opt/stack/data/nova/instances/d6ab7d82-da92-460f-9172-b635d396513e_del
Aug 01 12:15:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Deletion of /opt/stack/data/nova/instances/d6ab7d82-da92-460f-9172-b635d396513e_del complete
Aug 01 12:15:53 user nova-compute[72178]: INFO nova.compute.manager [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 01 12:15:53 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:15:53 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: d6ab7d82-da92-460f-9172-b635d396513e] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:15:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-786b3a33-ed3a-413b-893e-a33cab9e4b23 req-3eb49e4f-4dca-4a96-a8c5-77c4dc031e5c service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received event network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-786b3a33-ed3a-413b-893e-a33cab9e4b23 req-3eb49e4f-4dca-4a96-a8c5-77c4dc031e5c service nova] Acquiring lock "d6ab7d82-da92-460f-9172-b635d396513e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-786b3a33-ed3a-413b-893e-a33cab9e4b23 req-3eb49e4f-4dca-4a96-a8c5-77c4dc031e5c service nova] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-786b3a33-ed3a-413b-893e-a33cab9e4b23 req-3eb49e4f-4dca-4a96-a8c5-77c4dc031e5c service nova] Lock "d6ab7d82-da92-460f-9172-b635d396513e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-786b3a33-ed3a-413b-893e-a33cab9e4b23 req-3eb49e4f-4dca-4a96-a8c5-77c4dc031e5c service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] No waiting events found dispatching network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:15:54 user nova-compute[72178]: WARNING nova.compute.manager [req-786b3a33-ed3a-413b-893e-a33cab9e4b23 req-3eb49e4f-4dca-4a96-a8c5-77c4dc031e5c service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received unexpected event network-vif-plugged-a424854f-d402-47c0-952b-f405b7e31c4e for instance with vm_state active and task_state deleting.
Aug 01 12:15:55 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:15:55 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Took 1.31 seconds to deallocate network for instance.
Aug 01 12:15:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-2da7ce07-c826-4be4-9c1c-bef1f90db476 req-eec613f0-c780-477f-acc3-51eb81ede84a service nova] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Received event network-vif-deleted-a424854f-d402-47c0-952b-f405b7e31c4e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:15:55 user nova-compute[72178]: INFO nova.compute.manager [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 12:15:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Deleting volume: 354f73e0-5d66-4d03-acd9-e4f286fa0e3e {{(pid=72178) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 01 12:15:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:15:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:15:56 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:15:56 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:15:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:56 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Deleted allocations for instance d6ab7d82-da92-460f-9172-b635d396513e
Aug 01 12:15:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0ffea902-5a53-48eb-94ac-61b646f2ea66 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "d6ab7d82-da92-460f-9172-b635d396513e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.984s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:15:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "776b71c1-6696-4575-9c0d-e9340af62167" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:02 user nova-compute[72178]: INFO nova.compute.manager [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Terminating instance
Aug 01 12:16:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-6c291cf8-dc02-44b7-907d-322bdef8999b req-76af1fe0-983a-4076-9a29-a111f09d8d17 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6c291cf8-dc02-44b7-907d-322bdef8999b req-76af1fe0-983a-4076-9a29-a111f09d8d17 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6c291cf8-dc02-44b7-907d-322bdef8999b req-76af1fe0-983a-4076-9a29-a111f09d8d17 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6c291cf8-dc02-44b7-907d-322bdef8999b req-76af1fe0-983a-4076-9a29-a111f09d8d17 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-6c291cf8-dc02-44b7-907d-322bdef8999b req-76af1fe0-983a-4076-9a29-a111f09d8d17 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-6c291cf8-dc02-44b7-907d-322bdef8999b req-76af1fe0-983a-4076-9a29-a111f09d8d17 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-unplugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:16:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Instance destroyed successfully.
Aug 01 12:16:03 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'resources' on Instance uuid 776b71c1-6696-4575-9c0d-e9340af62167 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-136494262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-136494262',id=28,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:12:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-ddvy2rh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:14:16Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=776b71c1-6696-4575-9c0d-e9340af62167,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "e9f19544-b04e-4449-924c-7925cf503a56", "address": "fa:16:3e:d6:6b:b7", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9f19544-b0", "ovs_interfaceid": "e9f19544-b04e-4449-924c-7925cf503a56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=e9f19544-b04e-4449-924c-7925cf503a56,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f19544-b0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_vif [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=e9f19544-b04e-4449-924c-7925cf503a56,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f19544-b0') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9f19544-b0, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:03 user nova-compute[72178]: INFO os_vif [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6b:b7,bridge_name='br-int',has_traffic_filtering=True,id=e9f19544-b04e-4449-924c-7925cf503a56,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9f19544-b0')
Aug 01 12:16:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HClEGrQu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:16:03 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[511fe8bd-87b5-4ecc-b387-6410dcfcb5f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df8ebcb-f7e0-41f5-acfa-b8c04dd343db]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:03 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:16:03 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:03 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:03 user nova-compute[72178]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f (non-flash)
Aug 01 12:16:03 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:03 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f4756b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dd569a-58c5-4f7c-8192-9a52d214523a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4e1b80-fa43-40d7-9b99-20c6e0e09d0e]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1d19b3-986b-4d41-9d98-3b66cf20b8a7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7efb5ad-8ada-49a3-91fa-6477100f3213]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d6cf3b-0561-495f-8a68-32ef9cb7265e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[99568223-7e75-43e0-8a9e-d5c884b79a64]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f, portal: 172.16.0.220,3260]
Aug 01 12:16:03 user nova-compute[72178]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f, portal: 172.16.0.220,3260] successful.
Aug 01 12:16:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2e04741-b105-4a08-a399-d496e798a21f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bebb7f4-b97a-45d2-8180-9bb94eb44643]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] <== disconnect_volume: return (344ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:16:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Deleting instance files /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167_del
Aug 01 12:16:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Deletion of /opt/stack/data/nova/instances/776b71c1-6696-4575-9c0d-e9340af62167_del complete
Aug 01 12:16:03 user nova-compute[72178]: INFO nova.compute.manager [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Took 1.24 seconds to destroy the instance on the hypervisor.
Aug 01 12:16:03 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:16:03 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:04 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Took 0.52 seconds to deallocate network for instance.
Aug 01 12:16:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-9dde030c-2627-4466-aae2-0ee8d0c7b06c req-9081651e-0d77-4d3d-92ae-92752767753b service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-deleted-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:04 user nova-compute[72178]: INFO nova.compute.manager [req-9dde030c-2627-4466-aae2-0ee8d0c7b06c req-9081651e-0d77-4d3d-92ae-92752767753b service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Neutron deleted interface e9f19544-b04e-4449-924c-7925cf503a56; detaching it from the instance and deleting it from the info cache
Aug 01 12:16:04 user nova-compute[72178]: DEBUG nova.network.neutron [req-9dde030c-2627-4466-aae2-0ee8d0c7b06c req-9081651e-0d77-4d3d-92ae-92752767753b service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-9dde030c-2627-4466-aae2-0ee8d0c7b06c req-9081651e-0d77-4d3d-92ae-92752767753b service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Detach interface failed, port_id=e9f19544-b04e-4449-924c-7925cf503a56, reason: Instance 776b71c1-6696-4575-9c0d-e9340af62167 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-c827c9d9-39a4-442b-864a-c5eacb6da215 req-27f6de94-7c4a-45c7-a585-7a5e091ec6b4 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c827c9d9-39a4-442b-864a-c5eacb6da215 req-27f6de94-7c4a-45c7-a585-7a5e091ec6b4 service nova] Acquiring lock "776b71c1-6696-4575-9c0d-e9340af62167-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c827c9d9-39a4-442b-864a-c5eacb6da215 req-27f6de94-7c4a-45c7-a585-7a5e091ec6b4 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c827c9d9-39a4-442b-864a-c5eacb6da215 req-27f6de94-7c4a-45c7-a585-7a5e091ec6b4 service nova] Lock "776b71c1-6696-4575-9c0d-e9340af62167-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-c827c9d9-39a4-442b-864a-c5eacb6da215 req-27f6de94-7c4a-45c7-a585-7a5e091ec6b4 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] No waiting events found dispatching network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:04 user nova-compute[72178]: WARNING nova.compute.manager [req-c827c9d9-39a4-442b-864a-c5eacb6da215 req-27f6de94-7c4a-45c7-a585-7a5e091ec6b4 service nova] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Received unexpected event network-vif-plugged-e9f19544-b04e-4449-924c-7925cf503a56 for instance with vm_state active and task_state deleting.
Aug 01 12:16:04 user nova-compute[72178]: INFO nova.compute.manager [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 12:16:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:05 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:16:05 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:16:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:05 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Deleted allocations for instance 776b71c1-6696-4575-9c0d-e9340af62167
Aug 01 12:16:05 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3530b111-4ca5-4e7c-a347-6b652d77cfc2 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "776b71c1-6696-4575-9c0d-e9340af62167" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.033s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:08 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892153.2216487, d6ab7d82-da92-460f-9172-b635d396513e => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:16:08 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: d6ab7d82-da92-460f-9172-b635d396513e] VM Stopped (Lifecycle Event)
Aug 01 12:16:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c5121187-4171-42b7-a488-1e60d554bd6a None None] [instance: d6ab7d82-da92-460f-9172-b635d396513e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:16:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:16:16 user nova-compute[72178]: INFO nova.compute.claims [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Claim successful on node user
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:16:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.policy [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fae1f92a5fa44879a3a523589e12a5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af152857bb640f591e8f0a09ff89837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:16:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Creating image(s)
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "/opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "/opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk 1073741824" returned: 0 in 0.060s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Cannot resize image /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'migration_context' on Instance uuid f0ef243f-6c58-4991-97b1-0883d24dd6c9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Ensure instance console log exists: /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Successfully created port: 4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892163.0416372, 776b71c1-6696-4575-9c0d-e9340af62167 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:16:18 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] VM Stopped (Lifecycle Event)
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aaf5f92a-9fb1-4c97-9218-38cdaf601d83 None None] [instance: 776b71c1-6696-4575-9c0d-e9340af62167] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Successfully updated port: 4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquired lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updating instance_info_cache with network_info: [{"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-eb0f8c6d-08c8-4417-8ff4-c892a35bfd40 req-be08d854-e700-4237-9de5-96bd88da6bb4 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-changed-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-eb0f8c6d-08c8-4417-8ff4-c892a35bfd40 req-be08d854-e700-4237-9de5-96bd88da6bb4 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Refreshing instance network info cache due to event network-changed-4aea2bba-76d8-441e-a325-eccd19b2194f. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eb0f8c6d-08c8-4417-8ff4-c892a35bfd40 req-be08d854-e700-4237-9de5-96bd88da6bb4 service nova] Acquiring lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Releasing lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Instance network_info: |[{"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eb0f8c6d-08c8-4417-8ff4-c892a35bfd40 req-be08d854-e700-4237-9de5-96bd88da6bb4 service nova] Acquired lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-eb0f8c6d-08c8-4417-8ff4-c892a35bfd40 req-be08d854-e700-4237-9de5-96bd88da6bb4 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Refreshing network info cache for port 4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Start _get_guest_xml network_info=[{"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:16:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:16:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-220539021',display_name='tempest-TestStampPattern-server-220539021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-220539021',id=38,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY0D3vdAXP1Uw5iOPQrUFMzzsglvj6jvcAFaLJfftLI5qdjFbF3qmMqlBS6g6gXV6f3NDdy+mfkiStVBeHEEmPFhi29WKhEbf8vOEiEeuKxD5jDUbAuPzUzAbvJ63afJA==',key_name='tempest-TestStampPattern-274602689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af152857bb640f591e8f0a09ff89837',ramdisk_id='',reservation_id='r-oyl8aux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1531717549',owner_user_name='tempest-TestStampPattern-1531717549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:16:17Z,user_data=None,user_id='fae1f92a5fa44879a3a523589e12a5ef',uuid=f0ef243f-6c58-4991-97b1-0883d24dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converting VIF {"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:5a:ba,bridge_name='br-int',has_traffic_filtering=True,id=4aea2bba-76d8-441e-a325-eccd19b2194f,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aea2bba-76') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'pci_devices' on Instance uuid f0ef243f-6c58-4991-97b1-0883d24dd6c9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:16:18 user nova-compute[72178]:   <uuid>f0ef243f-6c58-4991-97b1-0883d24dd6c9</uuid>
Aug 01 12:16:18 user nova-compute[72178]:   <name>instance-00000026</name>
Aug 01 12:16:18 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:16:18 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:16:18 user nova-compute[72178]:   <metadata>
Aug 01 12:16:18 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:16:18 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:16:18 user nova-compute[72178]:       <nova:name>tempest-TestStampPattern-server-220539021</nova:name>
Aug 01 12:16:18 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:16:18</nova:creationTime>
Aug 01 12:16:18 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:16:18 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:16:18 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:16:18 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:16:18 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:16:18 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:16:18 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:16:18 user nova-compute[72178]:       <nova:owner>
Aug 01 12:16:18 user nova-compute[72178]:         <nova:user uuid="fae1f92a5fa44879a3a523589e12a5ef">tempest-TestStampPattern-1531717549-project-member</nova:user>
Aug 01 12:16:18 user nova-compute[72178]:         <nova:project uuid="0af152857bb640f591e8f0a09ff89837">tempest-TestStampPattern-1531717549</nova:project>
Aug 01 12:16:18 user nova-compute[72178]:       </nova:owner>
Aug 01 12:16:18 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:16:18 user nova-compute[72178]:       <nova:ports>
Aug 01 12:16:18 user nova-compute[72178]:         <nova:port uuid="4aea2bba-76d8-441e-a325-eccd19b2194f">
Aug 01 12:16:18 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 12:16:18 user nova-compute[72178]:         </nova:port>
Aug 01 12:16:18 user nova-compute[72178]:       </nova:ports>
Aug 01 12:16:18 user nova-compute[72178]:     </nova:instance>
Aug 01 12:16:18 user nova-compute[72178]:   </metadata>
Aug 01 12:16:18 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:16:18 user nova-compute[72178]:     <system>
Aug 01 12:16:18 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:16:18 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:16:18 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:16:18 user nova-compute[72178]:       <entry name="serial">f0ef243f-6c58-4991-97b1-0883d24dd6c9</entry>
Aug 01 12:16:18 user nova-compute[72178]:       <entry name="uuid">f0ef243f-6c58-4991-97b1-0883d24dd6c9</entry>
Aug 01 12:16:18 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:16:18 user nova-compute[72178]:     </system>
Aug 01 12:16:18 user nova-compute[72178]:   </sysinfo>
Aug 01 12:16:18 user nova-compute[72178]:   <os>
Aug 01 12:16:18 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:16:18 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:16:18 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:16:18 user nova-compute[72178]:   </os>
Aug 01 12:16:18 user nova-compute[72178]:   <features>
Aug 01 12:16:18 user nova-compute[72178]:     <acpi/>
Aug 01 12:16:18 user nova-compute[72178]:     <apic/>
Aug 01 12:16:18 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:16:18 user nova-compute[72178]:   </features>
Aug 01 12:16:18 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:16:18 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:16:18 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:16:18 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:16:18 user nova-compute[72178]:   </clock>
Aug 01 12:16:18 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:16:18 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:16:18 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:16:18 user nova-compute[72178]:   </cpu>
Aug 01 12:16:18 user nova-compute[72178]:   <devices>
Aug 01 12:16:18 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:16:18 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:16:18 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk"/>
Aug 01 12:16:18 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:16:18 user nova-compute[72178]:     </disk>
Aug 01 12:16:18 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:16:18 user nova-compute[72178]:       <mac address="fa:16:3e:ed:5a:ba"/>
Aug 01 12:16:18 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:16:18 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:16:18 user nova-compute[72178]:       <target dev="tap4aea2bba-76"/>
Aug 01 12:16:18 user nova-compute[72178]:     </interface>
Aug 01 12:16:18 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:16:18 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/console.log" append="off"/>
Aug 01 12:16:18 user nova-compute[72178]:     </serial>
Aug 01 12:16:18 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:16:18 user nova-compute[72178]:     <video>
Aug 01 12:16:18 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:16:18 user nova-compute[72178]:     </video>
Aug 01 12:16:18 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:16:18 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:16:18 user nova-compute[72178]:     </rng>
Aug 01 12:16:18 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:16:18 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:16:18 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:16:18 user nova-compute[72178]:     </memballoon>
Aug 01 12:16:18 user nova-compute[72178]:   </devices>
Aug 01 12:16:18 user nova-compute[72178]: </domain>
Aug 01 12:16:18 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-220539021',display_name='tempest-TestStampPattern-server-220539021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-220539021',id=38,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY0D3vdAXP1Uw5iOPQrUFMzzsglvj6jvcAFaLJfftLI5qdjFbF3qmMqlBS6g6gXV6f3NDdy+mfkiStVBeHEEmPFhi29WKhEbf8vOEiEeuKxD5jDUbAuPzUzAbvJ63afJA==',key_name='tempest-TestStampPattern-274602689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af152857bb640f591e8f0a09ff89837',ramdisk_id='',reservation_id='r-oyl8aux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1531717549',owner_user_name='tempest-TestStampPattern-1531717549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:16:17Z,user_data=None,user_id='fae1f92a5fa44879a3a523589e12a5ef',uuid=f0ef243f-6c58-4991-97b1-0883d24dd6c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converting VIF {"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:5a:ba,bridge_name='br-int',has_traffic_filtering=True,id=4aea2bba-76d8-441e-a325-eccd19b2194f,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aea2bba-76') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG os_vif [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:5a:ba,bridge_name='br-int',has_traffic_filtering=True,id=4aea2bba-76d8-441e-a325-eccd19b2194f,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aea2bba-76') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aea2bba-76, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4aea2bba-76, col_values=(('external_ids', {'iface-id': '4aea2bba-76d8-441e-a325-eccd19b2194f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:5a:ba', 'vm-uuid': 'f0ef243f-6c58-4991-97b1-0883d24dd6c9'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:18 user nova-compute[72178]: INFO os_vif [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:5a:ba,bridge_name='br-int',has_traffic_filtering=True,id=4aea2bba-76d8-441e-a325-eccd19b2194f,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aea2bba-76')
Aug 01 12:16:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No VIF found with MAC fa:16:3e:ed:5a:ba, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:16:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:19 user nova-compute[72178]: INFO nova.compute.manager [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attaching volume 8d588c17-5885-4eb8-929a-a57b733553e3 to /dev/vdb
Aug 01 12:16:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-eb0f8c6d-08c8-4417-8ff4-c892a35bfd40 req-be08d854-e700-4237-9de5-96bd88da6bb4 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updated VIF entry in instance network info cache for port 4aea2bba-76d8-441e-a325-eccd19b2194f. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-eb0f8c6d-08c8-4417-8ff4-c892a35bfd40 req-be08d854-e700-4237-9de5-96bd88da6bb4 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updating instance_info_cache with network_info: [{"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eb0f8c6d-08c8-4417-8ff4-c892a35bfd40 req-be08d854-e700-4237-9de5-96bd88da6bb4 service nova] Releasing lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG os_brick.utils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d574cc2-5ae8-4ce0-bb07-68fe43ef15a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e555f1-940c-4cca-906b-f53f9bed67e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62133c4-a9ec-4713-9611-e05ae87f802c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e79ba66-3518-4797-a052-9396d7de5542]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:16:19 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:16:19 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc24e88-19bb-4aa9-a4ca-c3ee4f64f318]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG os_brick.utils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:16:19 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating existing volume attachment record: 797c61b1-5c37-4a49-8a89-4a138c90bb5c {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-92830bec-b080-410d-adb5-4cde35e700ec req-50d21747-fdc5-4a60-ab3b-a756d3c1f38c service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-92830bec-b080-410d-adb5-4cde35e700ec req-50d21747-fdc5-4a60-ab3b-a756d3c1f38c service nova] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-92830bec-b080-410d-adb5-4cde35e700ec req-50d21747-fdc5-4a60-ab3b-a756d3c1f38c service nova] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-92830bec-b080-410d-adb5-4cde35e700ec req-50d21747-fdc5-4a60-ab3b-a756d3c1f38c service nova] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-92830bec-b080-410d-adb5-4cde35e700ec req-50d21747-fdc5-4a60-ab3b-a756d3c1f38c service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] No waiting events found dispatching network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:20 user nova-compute[72178]: WARNING nova.compute.manager [req-92830bec-b080-410d-adb5-4cde35e700ec req-50d21747-fdc5-4a60-ab3b-a756d3c1f38c service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received unexpected event network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f for instance with vm_state building and task_state spawning.
Aug 01 12:16:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892182.478347, f0ef243f-6c58-4991-97b1-0883d24dd6c9 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:16:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] VM Resumed (Lifecycle Event)
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:16:22 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Instance spawned successfully.
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:16:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892182.4789624, f0ef243f-6c58-4991-97b1-0883d24dd6c9 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:16:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] VM Started (Lifecycle Event)
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:16:22 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:16:22 user nova-compute[72178]: INFO nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:16:22 user nova-compute[72178]: INFO nova.compute.manager [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Took 6.57 seconds to build instance.
Aug 01 12:16:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a40af905-67a5-48d2-bf12-c4d992a3baf5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-b4d63391-82ed-4cc3-bb98-181d6f1fca82 req-1e0e5a4a-378b-4125-b0e3-b826ebe43505 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b4d63391-82ed-4cc3-bb98-181d6f1fca82 req-1e0e5a4a-378b-4125-b0e3-b826ebe43505 service nova] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b4d63391-82ed-4cc3-bb98-181d6f1fca82 req-1e0e5a4a-378b-4125-b0e3-b826ebe43505 service nova] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b4d63391-82ed-4cc3-bb98-181d6f1fca82 req-1e0e5a4a-378b-4125-b0e3-b826ebe43505 service nova] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:22 user nova-compute[72178]: DEBUG nova.compute.manager [req-b4d63391-82ed-4cc3-bb98-181d6f1fca82 req-1e0e5a4a-378b-4125-b0e3-b826ebe43505 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] No waiting events found dispatching network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:22 user nova-compute[72178]: WARNING nova.compute.manager [req-b4d63391-82ed-4cc3-bb98-181d6f1fca82 req-1e0e5a4a-378b-4125-b0e3-b826ebe43505 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received unexpected event network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f for instance with vm_state active and task_state None.
Aug 01 12:16:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPrVpcWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:16:27 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:16:27 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:16:27 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d3111-7408-4e60-bbe9-5a1c40d606ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:16:27 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[84906522-206c-4ad4-8d58-91e5cc585c59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3] added
Aug 01 12:16:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.124s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ad7500-1c9e-4ff6-a9f2-28946d40201a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[811ef93d-3ce9-4c43-9f12-211a44bf2dfe]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPrVpcWU {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oPrVpcWU" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba4b8f0-af00-44ed-89ae-228c85308ae6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oPrVpcWU'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e51bbd1-cc07-4ce1-b1f9-f082007574d3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f4ee27-251c-40cc-a9db-8a23be02f1db]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[00964a78-793c-4b08-9a2f-aa98755b1f7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3, portal: 172.16.0.220,3260]
Aug 01 12:16:27 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3, portal: 172.16.0.220,3260] successful.
Aug 01 12:16:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[51853719-7f0a-4c3a-add7-de85282a7f90]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858f1c6-d7a5-44be-b209-3496940315cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 (non-flash)
Aug 01 12:16:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3620726-444c-4b88-aee0-3b912f541ea0]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:16:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPrVpcWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23231383139613237', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231383139613237', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:16:28 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:16:28 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:16:28 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:16:28 user nova-compute[72178]:   <serial>8d588c17-5885-4eb8-929a-a57b733553e3</serial>
Aug 01 12:16:28 user nova-compute[72178]: </disk>
Aug 01 12:16:28 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:16:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] No VIF found with MAC fa:16:3e:d2:93:c8, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:16:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7480ac9f-0d07-4768-8bac-2d5444010c49 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.047s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:31 user nova-compute[72178]: INFO nova.compute.manager [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Detaching volume 8d588c17-5885-4eb8-929a-a57b733553e3
Aug 01 12:16:31 user nova-compute[72178]: INFO nova.virt.block_device [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Attempting to driver detach volume 8d588c17-5885-4eb8-929a-a57b733553e3 from mountpoint /dev/vdb
Aug 01 12:16:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Attempting to detach device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:16:31 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:16:31 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:16:31 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:16:31 user nova-compute[72178]:   <serial>8d588c17-5885-4eb8-929a-a57b733553e3</serial>
Aug 01 12:16:31 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:16:31 user nova-compute[72178]: </disk>
Aug 01 12:16:31 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:16:31 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully detached device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the persistent domain config.
Aug 01 12:16:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:16:31 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:16:31 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:16:31 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:16:31 user nova-compute[72178]:   <serial>8d588c17-5885-4eb8-929a-a57b733553e3</serial>
Aug 01 12:16:31 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:16:31 user nova-compute[72178]: </disk>
Aug 01 12:16:31 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892191.9351695, febae49f-2d0b-4f28-a695-0ecaaf120077 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:16:31 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully detached device vdb from instance febae49f-2d0b-4f28-a695-0ecaaf120077 from the live domain config.
Aug 01 12:16:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oPrVpcWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:16:31 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:16:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac5aded-580a-4e55-ae85-3a0f25de1133]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:31 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0bde88-2e6d-4cb5-9e97-a38e3478a493]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:32 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:32 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:32 user nova-compute[72178]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 (non-flash)
Aug 01 12:16:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:32 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:32 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:32 user nova-compute[72178]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 (non-flash)
Aug 01 12:16:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f463c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2a56c-c930-40a2-9e85-e927b0e80843]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c46d24-6d94-4fe2-a939-403e58e7f21b]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2268f4-f641-48a3-8822-ebf5bbfb81d9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20808f5-d3d3-4b32-8079-c652b01e2032]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd13e565-716d-4b1b-a1af-dc35a083332b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec586ab-eba5-4312-9087-91344205d354]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3, portal: 172.16.0.220,3260]
Aug 01 12:16:32 user nova-compute[72178]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3, portal: 172.16.0.220,3260] successful.
Aug 01 12:16:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d588c17-5885-4eb8-929a-a57b733553e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b55be-74fd-40a3-888e-7d64033dbb27]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] <== disconnect_volume: return (332ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:16:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:16:33 user nova-compute[72178]: DEBUG nova.objects.instance [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'flavor' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-79104481-e438-44da-80ed-92319359c508 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:34 user nova-compute[72178]: INFO nova.compute.manager [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Terminating instance
Aug 01 12:16:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-15a2e38c-e099-4b62-9da1-0c20abac40be req-1020e872-a6cc-4556-b83a-1a15de1627b8 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received event network-vif-unplugged-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-15a2e38c-e099-4b62-9da1-0c20abac40be req-1020e872-a6cc-4556-b83a-1a15de1627b8 service nova] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-15a2e38c-e099-4b62-9da1-0c20abac40be req-1020e872-a6cc-4556-b83a-1a15de1627b8 service nova] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-15a2e38c-e099-4b62-9da1-0c20abac40be req-1020e872-a6cc-4556-b83a-1a15de1627b8 service nova] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-15a2e38c-e099-4b62-9da1-0c20abac40be req-1020e872-a6cc-4556-b83a-1a15de1627b8 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] No waiting events found dispatching network-vif-unplugged-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-15a2e38c-e099-4b62-9da1-0c20abac40be req-1020e872-a6cc-4556-b83a-1a15de1627b8 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received event network-vif-unplugged-55817a06-eb38-4811-a4d8-41aeab256257 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:16:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Instance destroyed successfully.
Aug 01 12:16:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'resources' on Instance uuid be40c1ae-0b3e-43c6-804b-ce8158b49233 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-161172345',display_name='tempest-AttachVolumeNegativeTest-server-161172345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-161172345',id=30,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkOdEjD9EProSDLF6B6vhbLzqSDohdLQyReWO+9u9hBvamQLgDk0bd6znywNQxH1Iu19mxSQSAnvmA5838qGQek1uaR4c1Nzcbc9xz28JRD5kmEH/UgM5guPUt0/KYBQ==',key_name='tempest-keypair-1087726270',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:10:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-mibxukjb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:10:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=be40c1ae-0b3e-43c6-804b-ce8158b49233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "55817a06-eb38-4811-a4d8-41aeab256257", "address": "fa:16:3e:6b:33:8a", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55817a06-eb", "ovs_interfaceid": "55817a06-eb38-4811-a4d8-41aeab256257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=55817a06-eb38-4811-a4d8-41aeab256257,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55817a06-eb') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG os_vif [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=55817a06-eb38-4811-a4d8-41aeab256257,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55817a06-eb') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55817a06-eb, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:35 user nova-compute[72178]: INFO os_vif [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:33:8a,bridge_name='br-int',has_traffic_filtering=True,id=55817a06-eb38-4811-a4d8-41aeab256257,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55817a06-eb')
Aug 01 12:16:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Deleting instance files /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233_del
Aug 01 12:16:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Deletion of /opt/stack/data/nova/instances/be40c1ae-0b3e-43c6-804b-ce8158b49233_del complete
Aug 01 12:16:35 user nova-compute[72178]: INFO nova.compute.manager [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 12:16:35 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:16:35 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:36 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Took 0.96 seconds to deallocate network for instance.
Aug 01 12:16:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-db71eb23-4f15-418f-b799-83ef9e0ff60c req-79e075c1-fa4c-414b-8c0a-496d50e01063 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received event network-vif-deleted-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:36 user nova-compute[72178]: INFO nova.compute.manager [req-db71eb23-4f15-418f-b799-83ef9e0ff60c req-79e075c1-fa4c-414b-8c0a-496d50e01063 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Neutron deleted interface 55817a06-eb38-4811-a4d8-41aeab256257; detaching it from the instance and deleting it from the info cache
Aug 01 12:16:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-db71eb23-4f15-418f-b799-83ef9e0ff60c req-79e075c1-fa4c-414b-8c0a-496d50e01063 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-db71eb23-4f15-418f-b799-83ef9e0ff60c req-79e075c1-fa4c-414b-8c0a-496d50e01063 service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Detach interface failed, port_id=55817a06-eb38-4811-a4d8-41aeab256257, reason: Instance be40c1ae-0b3e-43c6-804b-ce8158b49233 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:36 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Deleted allocations for instance be40c1ae-0b3e-43c6-804b-ce8158b49233
Aug 01 12:16:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6802ae44-6db9-4df1-9fd9-148348190bd6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.290s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-1367b2c8-fbba-473c-ac39-7a4a4a26d340 req-8ddf9a22-c74b-4aca-836f-11fcf79b2f2d service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received event network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1367b2c8-fbba-473c-ac39-7a4a4a26d340 req-8ddf9a22-c74b-4aca-836f-11fcf79b2f2d service nova] Acquiring lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1367b2c8-fbba-473c-ac39-7a4a4a26d340 req-8ddf9a22-c74b-4aca-836f-11fcf79b2f2d service nova] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1367b2c8-fbba-473c-ac39-7a4a4a26d340 req-8ddf9a22-c74b-4aca-836f-11fcf79b2f2d service nova] Lock "be40c1ae-0b3e-43c6-804b-ce8158b49233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-1367b2c8-fbba-473c-ac39-7a4a4a26d340 req-8ddf9a22-c74b-4aca-836f-11fcf79b2f2d service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] No waiting events found dispatching network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:36 user nova-compute[72178]: WARNING nova.compute.manager [req-1367b2c8-fbba-473c-ac39-7a4a4a26d340 req-8ddf9a22-c74b-4aca-836f-11fcf79b2f2d service nova] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Received unexpected event network-vif-plugged-55817a06-eb38-4811-a4d8-41aeab256257 for instance with vm_state deleted and task_state None.
Aug 01 12:16:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:39 user nova-compute[72178]: INFO nova.compute.manager [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Terminating instance
Aug 01 12:16:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-aaeb8570-01e2-4266-96d7-f544820fa96f req-ed636be6-0ba4-4e2f-85bc-c602a9318809 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received event network-vif-unplugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aaeb8570-01e2-4266-96d7-f544820fa96f req-ed636be6-0ba4-4e2f-85bc-c602a9318809 service nova] Acquiring lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aaeb8570-01e2-4266-96d7-f544820fa96f req-ed636be6-0ba4-4e2f-85bc-c602a9318809 service nova] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aaeb8570-01e2-4266-96d7-f544820fa96f req-ed636be6-0ba4-4e2f-85bc-c602a9318809 service nova] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-aaeb8570-01e2-4266-96d7-f544820fa96f req-ed636be6-0ba4-4e2f-85bc-c602a9318809 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] No waiting events found dispatching network-vif-unplugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-aaeb8570-01e2-4266-96d7-f544820fa96f req-ed636be6-0ba4-4e2f-85bc-c602a9318809 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received event network-vif-unplugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Instance destroyed successfully.
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lazy-loading 'resources' on Instance uuid f3a2f566-6844-403b-bdba-b9ad4e0a9d6f {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-301316349',display_name='tempest-VolumesActionsTest-instance-301316349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-301316349',id=37,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:14:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e82a73d8a1944928b14ff263f3a2d385',ramdisk_id='',reservation_id='r-qxdqui90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-439234941',owner_user_name='tempest-VolumesActionsTest-439234941-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:15:00Z,user_data=None,user_id='ec07389bdd7847469b8376941948997c',uuid=f3a2f566-6844-403b-bdba-b9ad4e0a9d6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converting VIF {"id": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "address": "fa:16:3e:2f:8c:1d", "network": {"id": "fe79785b-24db-4dc1-95c4-8bdc34543e31", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2075891934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e82a73d8a1944928b14ff263f3a2d385", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37bd9edf-6b", "ovs_interfaceid": "37bd9edf-6b78-4f33-a23d-d17f8685de51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8c:1d,bridge_name='br-int',has_traffic_filtering=True,id=37bd9edf-6b78-4f33-a23d-d17f8685de51,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bd9edf-6b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG os_vif [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8c:1d,bridge_name='br-int',has_traffic_filtering=True,id=37bd9edf-6b78-4f33-a23d-d17f8685de51,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bd9edf-6b') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37bd9edf-6b, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:40 user nova-compute[72178]: INFO os_vif [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:8c:1d,bridge_name='br-int',has_traffic_filtering=True,id=37bd9edf-6b78-4f33-a23d-d17f8685de51,network=Network(fe79785b-24db-4dc1-95c4-8bdc34543e31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37bd9edf-6b')
Aug 01 12:16:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Deleting instance files /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f_del
Aug 01 12:16:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Deletion of /opt/stack/data/nova/instances/f3a2f566-6844-403b-bdba-b9ad4e0a9d6f_del complete
Aug 01 12:16:40 user nova-compute[72178]: INFO nova.compute.manager [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Took 0.65 seconds to destroy the instance on the hypervisor.
Aug 01 12:16:40 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:40 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Took 0.43 seconds to deallocate network for instance.
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-b3a70f27-091f-4692-be4d-43b425899b2f req-86c698a5-fc4a-4545-9b35-9ee5f96f9519 service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received event network-vif-deleted-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:16:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:40 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Deleted allocations for instance f3a2f566-6844-403b-bdba-b9ad4e0a9d6f
Aug 01 12:16:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2c2b900e-31b0-46da-b9c1-0ec15555df76 tempest-VolumesActionsTest-439234941 tempest-VolumesActionsTest-439234941-project-member] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.519s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-9bde1b80-f88f-4817-aae6-759b32b38b40 req-3eb4082c-91ab-43c9-8031-a954c7f5f3aa service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received event network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9bde1b80-f88f-4817-aae6-759b32b38b40 req-3eb4082c-91ab-43c9-8031-a954c7f5f3aa service nova] Acquiring lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9bde1b80-f88f-4817-aae6-759b32b38b40 req-3eb4082c-91ab-43c9-8031-a954c7f5f3aa service nova] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9bde1b80-f88f-4817-aae6-759b32b38b40 req-3eb4082c-91ab-43c9-8031-a954c7f5f3aa service nova] Lock "f3a2f566-6844-403b-bdba-b9ad4e0a9d6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-9bde1b80-f88f-4817-aae6-759b32b38b40 req-3eb4082c-91ab-43c9-8031-a954c7f5f3aa service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] No waiting events found dispatching network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:41 user nova-compute[72178]: WARNING nova.compute.manager [req-9bde1b80-f88f-4817-aae6-759b32b38b40 req-3eb4082c-91ab-43c9-8031-a954c7f5f3aa service nova] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Received unexpected event network-vif-plugged-37bd9edf-6b78-4f33-a23d-d17f8685de51 for instance with vm_state deleted and task_state None.
Aug 01 12:16:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:16:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:16:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updating instance_info_cache with network_info: [{"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-d3870f4a-ea47-4075-b342-2b20cfa749f9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:16:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:16:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:16:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:16:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:16:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7827MB free_disk=25.013378143310547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance d3870f4a-ea47-4075-b342-2b20cfa749f9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance febae49f-2d0b-4f28-a695-0ecaaf120077 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance c4621d07-791b-49da-97b3-aa8558914e7b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:16:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-b44b5105-2099-49d3-b1a3-930ce80ce877 req-150088cb-a098-46ca-8c2b-673d37ac8a15 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-b44b5105-2099-49d3-b1a3-930ce80ce877 req-150088cb-a098-46ca-8c2b-673d37ac8a15 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing instance network info cache due to event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:16:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b44b5105-2099-49d3-b1a3-930ce80ce877 req-150088cb-a098-46ca-8c2b-673d37ac8a15 service nova] Acquiring lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:16:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b44b5105-2099-49d3-b1a3-930ce80ce877 req-150088cb-a098-46ca-8c2b-673d37ac8a15 service nova] Acquired lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:16:49 user nova-compute[72178]: DEBUG nova.network.neutron [req-b44b5105-2099-49d3-b1a3-930ce80ce877 req-150088cb-a098-46ca-8c2b-673d37ac8a15 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:16:49 user nova-compute[72178]: DEBUG nova.network.neutron [req-b44b5105-2099-49d3-b1a3-930ce80ce877 req-150088cb-a098-46ca-8c2b-673d37ac8a15 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updated VIF entry in instance network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:16:49 user nova-compute[72178]: DEBUG nova.network.neutron [req-b44b5105-2099-49d3-b1a3-930ce80ce877 req-150088cb-a098-46ca-8c2b-673d37ac8a15 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b44b5105-2099-49d3-b1a3-930ce80ce877 req-150088cb-a098-46ca-8c2b-673d37ac8a15 service nova] Releasing lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-05c67847-7a3e-4d66-aa53-e97b45ded328 req-65776a3a-b0a9-47d7-a2c1-6076a21e349c service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-05c67847-7a3e-4d66-aa53-e97b45ded328 req-65776a3a-b0a9-47d7-a2c1-6076a21e349c service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing instance network info cache due to event network-changed-4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-05c67847-7a3e-4d66-aa53-e97b45ded328 req-65776a3a-b0a9-47d7-a2c1-6076a21e349c service nova] Acquiring lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-05c67847-7a3e-4d66-aa53-e97b45ded328 req-65776a3a-b0a9-47d7-a2c1-6076a21e349c service nova] Acquired lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-05c67847-7a3e-4d66-aa53-e97b45ded328 req-65776a3a-b0a9-47d7-a2c1-6076a21e349c service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Refreshing network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892195.1363544, be40c1ae-0b3e-43c6-804b-ce8158b49233 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:16:50 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] VM Stopped (Lifecycle Event)
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cbb91db1-ac5d-4e77-8360-1a3029c2cce2 None None] [instance: be40c1ae-0b3e-43c6-804b-ce8158b49233] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:50 user nova-compute[72178]: INFO nova.compute.manager [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Detaching volume 1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0
Aug 01 12:16:50 user nova-compute[72178]: INFO nova.virt.block_device [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Attempting to driver detach volume 1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 from mountpoint /dev/vdb
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Attempting to detach device vdb from instance c4621d07-791b-49da-97b3-aa8558914e7b from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:16:50 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:16:50 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:16:50 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:16:50 user nova-compute[72178]:   <serial>1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0</serial>
Aug 01 12:16:50 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:16:50 user nova-compute[72178]: </disk>
Aug 01 12:16:50 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:16:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully detached device vdb from instance c4621d07-791b-49da-97b3-aa8558914e7b from the persistent domain config.
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c4621d07-791b-49da-97b3-aa8558914e7b from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:16:50 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:16:50 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:16:50 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:16:50 user nova-compute[72178]:   <serial>1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0</serial>
Aug 01 12:16:50 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:16:50 user nova-compute[72178]: </disk>
Aug 01 12:16:50 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-05c67847-7a3e-4d66-aa53-e97b45ded328 req-65776a3a-b0a9-47d7-a2c1-6076a21e349c service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updated VIF entry in instance network info cache for port 4d0afb8c-1700-4680-b0cf-4f19ce23d15e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.network.neutron [req-05c67847-7a3e-4d66-aa53-e97b45ded328 req-65776a3a-b0a9-47d7-a2c1-6076a21e349c service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [{"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-05c67847-7a3e-4d66-aa53-e97b45ded328 req-65776a3a-b0a9-47d7-a2c1-6076a21e349c service nova] Releasing lock "refresh_cache-c4621d07-791b-49da-97b3-aa8558914e7b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892210.806364, c4621d07-791b-49da-97b3-aa8558914e7b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c4621d07-791b-49da-97b3-aa8558914e7b {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:16:50 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully detached device vdb from instance c4621d07-791b-49da-97b3-aa8558914e7b from the live domain config.
Aug 01 12:16:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXPMytni', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:16:50 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[84564168-b2c4-46c0-84db-d451f7fffcd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb029af4-d07d-4ac4-b1ef-ba241b888586]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:50 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:50 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:16:50 user nova-compute[72178]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 (non-flash)
Aug 01 12:16:50 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:16:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d425d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1410db-765a-461d-992d-5bbbd308b2e5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dab1a43-022b-4770-a6af-ddb9c6700381]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b078ec-4e04-4e5f-8988-69bef8481c0a]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0876bd8b-2d82-4f6e-a9ce-0fa8bd9ce319]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a2ab36-cd09-429d-9b74-53bd669cf66c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e837556-19fb-4262-926c-ffca998e2a28]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0, portal: 172.16.0.220,3260]
Aug 01 12:16:51 user nova-compute[72178]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0, portal: 172.16.0.220,3260] successful.
Aug 01 12:16:51 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d28e7e3-e6a6-4e40-b0c6-8145ddf651e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d3c8f2-b2b2-4b42-958b-9bd71e662827]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] <== disconnect_volume: return (302ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG nova.objects.instance [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'flavor' on Instance uuid c4621d07-791b-49da-97b3-aa8558914e7b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-3a6af320-5d68-4b8f-a6cd-6ee9596cb115 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.596s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:53 user nova-compute[72178]: INFO nova.compute.manager [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Terminating instance
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-b559c9cb-5049-4ac5-96e6-e8595a84b4b7 req-351bdec5-fce1-4670-a060-28eec91e5fd2 service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received event network-vif-unplugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b559c9cb-5049-4ac5-96e6-e8595a84b4b7 req-351bdec5-fce1-4670-a060-28eec91e5fd2 service nova] Acquiring lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b559c9cb-5049-4ac5-96e6-e8595a84b4b7 req-351bdec5-fce1-4670-a060-28eec91e5fd2 service nova] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b559c9cb-5049-4ac5-96e6-e8595a84b4b7 req-351bdec5-fce1-4670-a060-28eec91e5fd2 service nova] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-b559c9cb-5049-4ac5-96e6-e8595a84b4b7 req-351bdec5-fce1-4670-a060-28eec91e5fd2 service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] No waiting events found dispatching network-vif-unplugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-b559c9cb-5049-4ac5-96e6-e8595a84b4b7 req-351bdec5-fce1-4670-a060-28eec91e5fd2 service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received event network-vif-unplugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:16:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Instance destroyed successfully.
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'resources' on Instance uuid 004ce11d-31dc-41dc-a5ac-b639c4c8486d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:07:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-250235509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-250235509',id=24,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:07:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-tpaphul1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:09:26Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=004ce11d-31dc-41dc-a5ac-b639c4c8486d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "address": "fa:16:3e:c3:5f:57", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9a086d-a7", "ovs_interfaceid": "7f9a086d-a7d3-4d59-80c2-e2db1415b5a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5f:57,bridge_name='br-int',has_traffic_filtering=True,id=7f9a086d-a7d3-4d59-80c2-e2db1415b5a7,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9a086d-a7') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG os_vif [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5f:57,bridge_name='br-int',has_traffic_filtering=True,id=7f9a086d-a7d3-4d59-80c2-e2db1415b5a7,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9a086d-a7') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f9a086d-a7, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:16:53 user nova-compute[72178]: INFO os_vif [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:5f:57,bridge_name='br-int',has_traffic_filtering=True,id=7f9a086d-a7d3-4d59-80c2-e2db1415b5a7,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9a086d-a7')
Aug 01 12:16:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Deleting instance files /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d_del
Aug 01 12:16:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Deletion of /opt/stack/data/nova/instances/004ce11d-31dc-41dc-a5ac-b639c4c8486d_del complete
Aug 01 12:16:53 user nova-compute[72178]: INFO nova.compute.manager [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 01 12:16:53 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:16:53 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:54 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Took 0.59 seconds to deallocate network for instance.
Aug 01 12:16:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-d855d287-b594-412a-bfdb-681138b5c7c2 req-1d86f13e-ec71-4dae-b81d-03ba93a13504 service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received event network-vif-deleted-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.102s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:54 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:16:54 user nova-compute[72178]: INFO nova.compute.claims [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Claim successful on node user
Aug 01 12:16:54 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Deleted allocations for instance 004ce11d-31dc-41dc-a5ac-b639c4c8486d
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892200.1021912, f3a2f566-6844-403b-bdba-b9ad4e0a9d6f => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:16:55 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] VM Stopped (Lifecycle Event)
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ff3fcda8-563a-4140-bae4-fdfb513f5646 None None] [instance: f3a2f566-6844-403b-bdba-b9ad4e0a9d6f] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7d390ca7-0a01-43b8-92f1-9d5f5d8b0fe7 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.480s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-45c0bf57-3cfc-42e9-8afe-6d97fe237e2b req-884fcef0-62e1-42d9-bbd3-995f24792e71 service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received event network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-45c0bf57-3cfc-42e9-8afe-6d97fe237e2b req-884fcef0-62e1-42d9-bbd3-995f24792e71 service nova] Acquiring lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-45c0bf57-3cfc-42e9-8afe-6d97fe237e2b req-884fcef0-62e1-42d9-bbd3-995f24792e71 service nova] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-45c0bf57-3cfc-42e9-8afe-6d97fe237e2b req-884fcef0-62e1-42d9-bbd3-995f24792e71 service nova] Lock "004ce11d-31dc-41dc-a5ac-b639c4c8486d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-45c0bf57-3cfc-42e9-8afe-6d97fe237e2b req-884fcef0-62e1-42d9-bbd3-995f24792e71 service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] No waiting events found dispatching network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:16:55 user nova-compute[72178]: WARNING nova.compute.manager [req-45c0bf57-3cfc-42e9-8afe-6d97fe237e2b req-884fcef0-62e1-42d9-bbd3-995f24792e71 service nova] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Received unexpected event network-vif-plugged-7f9a086d-a7d3-4d59-80c2-e2db1415b5a7 for instance with vm_state deleted and task_state None.
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:16:55 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:16:55 user nova-compute[72178]: INFO nova.virt.block_device [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Booting with volume 03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe at /dev/vda
Aug 01 12:16:55 user nova-compute[72178]: DEBUG nova.policy [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef22394fbdfd4aad8c301596a2ee7b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0eb9e0006c46dabba55cc95cca217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG os_brick.utils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc47237-faad-4918-b58d-317cd038dee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da9db60-a11b-41bd-a761-3b4edb4ae1c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bec5263-8df8-43c4-bb94-e954326940ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5abc33-cc98-4c65-84f8-3bb09cb7d860]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:16:56 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:16:56 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd88745f-42bf-4b16-93ba-8125c34d3eec]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG os_brick.utils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Updating existing volume attachment record: f59c21ce-a0b7-4472-8653-4df863badaa9 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:16:56 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Successfully created port: 06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Successfully updated port: 06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquired lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-4d7b8bbf-a46c-4ab2-97f7-16c75a2f8582 req-b5ea1a5e-54b0-4926-8a1c-97acb79af3c5 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received event network-changed-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-4d7b8bbf-a46c-4ab2-97f7-16c75a2f8582 req-b5ea1a5e-54b0-4926-8a1c-97acb79af3c5 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Refreshing instance network info cache due to event network-changed-06f5474e-80b3-4c75-b7c5-3033ce9141c2. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4d7b8bbf-a46c-4ab2-97f7-16c75a2f8582 req-b5ea1a5e-54b0-4926-8a1c-97acb79af3c5 service nova] Acquiring lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Updating instance_info_cache with network_info: [{"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Releasing lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Instance network_info: |[{"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4d7b8bbf-a46c-4ab2-97f7-16c75a2f8582 req-b5ea1a5e-54b0-4926-8a1c-97acb79af3c5 service nova] Acquired lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:16:57 user nova-compute[72178]: DEBUG nova.network.neutron [req-4d7b8bbf-a46c-4ab2-97f7-16c75a2f8582 req-b5ea1a5e-54b0-4926-8a1c-97acb79af3c5 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Refreshing network info cache for port 06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:16:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-4d7b8bbf-a46c-4ab2-97f7-16c75a2f8582 req-b5ea1a5e-54b0-4926-8a1c-97acb79af3c5 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Updated VIF entry in instance network info cache for port 06f5474e-80b3-4c75-b7c5-3033ce9141c2. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:16:58 user nova-compute[72178]: DEBUG nova.network.neutron [req-4d7b8bbf-a46c-4ab2-97f7-16c75a2f8582 req-b5ea1a5e-54b0-4926-8a1c-97acb79af3c5 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Updating instance_info_cache with network_info: [{"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:16:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4d7b8bbf-a46c-4ab2-97f7-16c75a2f8582 req-b5ea1a5e-54b0-4926-8a1c-97acb79af3c5 service nova] Releasing lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:16:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:17:03 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Creating image(s)
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Ensure instance console log exists: /opt/stack/data/nova/instances/f83a6749-76c7-4af7-b72d-9bc3d4d4cab9/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Start _get_guest_xml network_info=[{"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDeisuSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f83a6749-76c7-4af7-b72d-9bc3d4d4cab9', 'attached_at': '', 'detached_at': '', 'volume_id': '03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe', 'serial': '03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'}, 'boot_index': 0, 'attachment_id': 'f59c21ce-a0b7-4472-8653-4df863badaa9', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:17:03 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:17:03 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDeisuSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:17:03 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:17:03 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:17:03 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc0f98f-f2dd-4657-a9ce-88de81ca81c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:17:03 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29590f9-c8d4-4e30-a275-133798643f42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe] added
Aug 01 12:17:03 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f0d8ee-6447-4e72-8fad-30e6cb96acd6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e61b203-4fd2-4976-9f76-101b9a52c587]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDeisuSj {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDeisuSj" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7495378-2b1f-41a5-9001-f2f1dde5f6eb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TDeisuSj'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.128s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0154913-55f1-4ece-a943-347174a74b7b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8bcc9c-bcc6-4846-8738-524a907daa27]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:04 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:04 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58d269e-e793-4931-aed7-d135f91ae38e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260]
Aug 01 12:17:04 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260] successful.
Aug 01 12:17:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ea5a91-845e-4eb8-af6b-d07f628865ce]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea499e0-ad0c-4070-928c-dbf92c3158f8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:04 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:04 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:04 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:04 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:04 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66ad181-cdc3-42ac-bb98-278e1b787658]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:17:04 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDeisuSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26235306163326135', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235306163326135', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1114288860',display_name='tempest-TestVolumeBootPattern-server-1114288860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1114288860',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-gfwwc447',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:16:56Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=f83a6749-76c7-4af7-b72d-9bc3d4d4cab9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:20:11,bridge_name='br-int',has_traffic_filtering=True,id=06f5474e-80b3-4c75-b7c5-3033ce9141c2,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f5474e-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'pci_devices' on Instance uuid f83a6749-76c7-4af7-b72d-9bc3d4d4cab9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:17:05 user nova-compute[72178]:   <uuid>f83a6749-76c7-4af7-b72d-9bc3d4d4cab9</uuid>
Aug 01 12:17:05 user nova-compute[72178]:   <name>instance-00000027</name>
Aug 01 12:17:05 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:17:05 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:17:05 user nova-compute[72178]:   <metadata>
Aug 01 12:17:05 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:17:05 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:17:05 user nova-compute[72178]:       <nova:name>tempest-TestVolumeBootPattern-server-1114288860</nova:name>
Aug 01 12:17:05 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:17:03</nova:creationTime>
Aug 01 12:17:05 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:17:05 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:17:05 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:17:05 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:17:05 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:17:05 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:17:05 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:17:05 user nova-compute[72178]:       <nova:owner>
Aug 01 12:17:05 user nova-compute[72178]:         <nova:user uuid="ef22394fbdfd4aad8c301596a2ee7b61">tempest-TestVolumeBootPattern-1003407750-project-member</nova:user>
Aug 01 12:17:05 user nova-compute[72178]:         <nova:project uuid="1e0eb9e0006c46dabba55cc95cca217f">tempest-TestVolumeBootPattern-1003407750</nova:project>
Aug 01 12:17:05 user nova-compute[72178]:       </nova:owner>
Aug 01 12:17:05 user nova-compute[72178]:       <nova:ports>
Aug 01 12:17:05 user nova-compute[72178]:         <nova:port uuid="06f5474e-80b3-4c75-b7c5-3033ce9141c2">
Aug 01 12:17:05 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 01 12:17:05 user nova-compute[72178]:         </nova:port>
Aug 01 12:17:05 user nova-compute[72178]:       </nova:ports>
Aug 01 12:17:05 user nova-compute[72178]:     </nova:instance>
Aug 01 12:17:05 user nova-compute[72178]:   </metadata>
Aug 01 12:17:05 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:17:05 user nova-compute[72178]:     <system>
Aug 01 12:17:05 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:17:05 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:17:05 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:17:05 user nova-compute[72178]:       <entry name="serial">f83a6749-76c7-4af7-b72d-9bc3d4d4cab9</entry>
Aug 01 12:17:05 user nova-compute[72178]:       <entry name="uuid">f83a6749-76c7-4af7-b72d-9bc3d4d4cab9</entry>
Aug 01 12:17:05 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:17:05 user nova-compute[72178]:     </system>
Aug 01 12:17:05 user nova-compute[72178]:   </sysinfo>
Aug 01 12:17:05 user nova-compute[72178]:   <os>
Aug 01 12:17:05 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:17:05 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:17:05 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:17:05 user nova-compute[72178]:   </os>
Aug 01 12:17:05 user nova-compute[72178]:   <features>
Aug 01 12:17:05 user nova-compute[72178]:     <acpi/>
Aug 01 12:17:05 user nova-compute[72178]:     <apic/>
Aug 01 12:17:05 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:17:05 user nova-compute[72178]:   </features>
Aug 01 12:17:05 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:17:05 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:17:05 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:17:05 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:17:05 user nova-compute[72178]:   </clock>
Aug 01 12:17:05 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:17:05 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:17:05 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:17:05 user nova-compute[72178]:   </cpu>
Aug 01 12:17:05 user nova-compute[72178]:   <devices>
Aug 01 12:17:05 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:17:05 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:17:05 user nova-compute[72178]:       <source dev="/dev/sdc"/>
Aug 01 12:17:05 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:17:05 user nova-compute[72178]:       <serial>03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe</serial>
Aug 01 12:17:05 user nova-compute[72178]:     </disk>
Aug 01 12:17:05 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:17:05 user nova-compute[72178]:       <mac address="fa:16:3e:9d:20:11"/>
Aug 01 12:17:05 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:17:05 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:17:05 user nova-compute[72178]:       <target dev="tap06f5474e-80"/>
Aug 01 12:17:05 user nova-compute[72178]:     </interface>
Aug 01 12:17:05 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:17:05 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/f83a6749-76c7-4af7-b72d-9bc3d4d4cab9/console.log" append="off"/>
Aug 01 12:17:05 user nova-compute[72178]:     </serial>
Aug 01 12:17:05 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:17:05 user nova-compute[72178]:     <video>
Aug 01 12:17:05 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:17:05 user nova-compute[72178]:     </video>
Aug 01 12:17:05 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:17:05 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:17:05 user nova-compute[72178]:     </rng>
Aug 01 12:17:05 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:17:05 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:17:05 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:17:05 user nova-compute[72178]:     </memballoon>
Aug 01 12:17:05 user nova-compute[72178]:   </devices>
Aug 01 12:17:05 user nova-compute[72178]: </domain>
Aug 01 12:17:05 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1114288860',display_name='tempest-TestVolumeBootPattern-server-1114288860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1114288860',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-gfwwc447',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:16:56Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=f83a6749-76c7-4af7-b72d-9bc3d4d4cab9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:20:11,bridge_name='br-int',has_traffic_filtering=True,id=06f5474e-80b3-4c75-b7c5-3033ce9141c2,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f5474e-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG os_vif [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:20:11,bridge_name='br-int',has_traffic_filtering=True,id=06f5474e-80b3-4c75-b7c5-3033ce9141c2,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f5474e-80') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06f5474e-80, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap06f5474e-80, col_values=(('external_ids', {'iface-id': '06f5474e-80b3-4c75-b7c5-3033ce9141c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:20:11', 'vm-uuid': 'f83a6749-76c7-4af7-b72d-9bc3d4d4cab9'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:05 user nova-compute[72178]: INFO os_vif [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:20:11,bridge_name='br-int',has_traffic_filtering=True,id=06f5474e-80b3-4c75-b7c5-3033ce9141c2,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f5474e-80')
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:17:05 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No VIF found with MAC fa:16:3e:9d:20:11, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:17:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-93efeea8-a67d-4c64-822e-47c1b20efa43 req-15cc00b5-8189-478c-8660-571a47158795 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received event network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-93efeea8-a67d-4c64-822e-47c1b20efa43 req-15cc00b5-8189-478c-8660-571a47158795 service nova] Acquiring lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-93efeea8-a67d-4c64-822e-47c1b20efa43 req-15cc00b5-8189-478c-8660-571a47158795 service nova] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-93efeea8-a67d-4c64-822e-47c1b20efa43 req-15cc00b5-8189-478c-8660-571a47158795 service nova] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-93efeea8-a67d-4c64-822e-47c1b20efa43 req-15cc00b5-8189-478c-8660-571a47158795 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] No waiting events found dispatching network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:06 user nova-compute[72178]: WARNING nova.compute.manager [req-93efeea8-a67d-4c64-822e-47c1b20efa43 req-15cc00b5-8189-478c-8660-571a47158795 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received unexpected event network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 for instance with vm_state building and task_state spawning.
Aug 01 12:17:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:07 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892213.6966286, 004ce11d-31dc-41dc-a5ac-b639c4c8486d => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:17:08 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] VM Stopped (Lifecycle Event)
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-afd9c1d3-2a8c-4c9e-8954-a7b239226a46 None None] [instance: 004ce11d-31dc-41dc-a5ac-b639c4c8486d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892228.7577689, f83a6749-76c7-4af7-b72d-9bc3d4d4cab9 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:17:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] VM Resumed (Lifecycle Event)
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:17:08 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Instance spawned successfully.
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892228.7618752, f83a6749-76c7-4af7-b72d-9bc3d4d4cab9 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:17:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] VM Started (Lifecycle Event)
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:17:08 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:17:08 user nova-compute[72178]: INFO nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-80e13d75-12d7-4f5d-b74b-e070347cdb9b req-6d0b2af8-632a-403e-95b3-38f2678b7196 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received event network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-80e13d75-12d7-4f5d-b74b-e070347cdb9b req-6d0b2af8-632a-403e-95b3-38f2678b7196 service nova] Acquiring lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-80e13d75-12d7-4f5d-b74b-e070347cdb9b req-6d0b2af8-632a-403e-95b3-38f2678b7196 service nova] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-80e13d75-12d7-4f5d-b74b-e070347cdb9b req-6d0b2af8-632a-403e-95b3-38f2678b7196 service nova] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-80e13d75-12d7-4f5d-b74b-e070347cdb9b req-6d0b2af8-632a-403e-95b3-38f2678b7196 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] No waiting events found dispatching network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:08 user nova-compute[72178]: WARNING nova.compute.manager [req-80e13d75-12d7-4f5d-b74b-e070347cdb9b req-6d0b2af8-632a-403e-95b3-38f2678b7196 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received unexpected event network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 for instance with vm_state building and task_state spawning.
Aug 01 12:17:08 user nova-compute[72178]: INFO nova.compute.manager [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Took 14.33 seconds to build instance.
Aug 01 12:17:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a44a22b2-c91d-46cc-96c0-5010d36d6fc2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.415s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquired lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'info_cache' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.network.neutron [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Releasing lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:17:17 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance destroyed successfully.
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'resources' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_vif [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape15e122f-e6, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:17:17 user nova-compute[72178]: INFO os_vif [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6')
Aug 01 12:17:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwUSojVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:17:17 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[687912b4-b6f2-4e3f-9ffe-b0817f0b677f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36adb89-ae2f-4c63-91ed-95f464feac3f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:17 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:17 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:17 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:17 user nova-compute[72178]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:17 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:17 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040cb0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34'): ({'sdh'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Removing single pathed devices sdh {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee0c79a-f6e7-4a7e-9dde-49a3e0fb16dc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4293c402-2db7-4add-a326-63912eea297d]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flushing IO for device /dev/sdh {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bb6ca5-6002-4897-bc26-2b9600477840]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab141401-20ad-4700-bcd3-b289beb19b45]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] SCSI volumes sdh have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9e8484-aced-40a3-be33-c1f15fc90e1b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ad0a4-0c09-4056-a4c2-6a3eee5a683e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260]
Aug 01 12:17:18 user nova-compute[72178]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260] successful.
Aug 01 12:17:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.063s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[197bb40c-5a6c-4b5d-a614-4870f253963c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== disconnect_volume: return (388ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Start _get_guest_xml network_info=[{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwUSojVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '6c816328-61df-4625-95e6-bc27fbd7148d', 'attached_at': '', 'detached_at': '', 'volume_id': '99579ea8-a988-4a66-bd52-c38d5d003d34', 'serial': '99579ea8-a988-4a66-bd52-c38d5d003d34'}, 'boot_index': None, 'attachment_id': '50b42eaf-2153-4bf3-9b92-ea87bfc3c8e5', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:17:18 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwUSojVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:17:18 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:17:18 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:17:18 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cca6ae-3fcb-4cdd-b5a3-9c1e8ec31837]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:17:18 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c027261b-0ddf-4a19-bd35-eab4f6de255b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34] added
Aug 01 12:17:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0198ea21-8d36-4da3-8889-0a33c6bac2f0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0451d4c2-2bda-41e8-bf42-2a050efd7805]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwUSojVE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwUSojVE" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cbc223-a9cb-42d2-8826-bc60acf408f4]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mwUSojVE'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e69c62a-9bf2-48cf-980e-7cf781b3c131]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8810fe8e-1d52-446a-85fc-93de43c59046]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:18 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:18 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeab4f14-bf98-471d-9114-9ad32ca014ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260]
Aug 01 12:17:18 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260] successful.
Aug 01 12:17:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b52af-35c5-40cd-a094-e98ba27d1191]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9aa14-1284-4869-a14e-45e6cfc6747b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:18 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:18 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:18 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:18 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:18 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c833c1da-e7ff-4c90-ae1f-49bccc8f354b]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:17:18 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwUSojVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23837353130333035', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837353130333035', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:17:19 user nova-compute[72178]:   <uuid>6c816328-61df-4625-95e6-bc27fbd7148d</uuid>
Aug 01 12:17:19 user nova-compute[72178]:   <name>instance-00000024</name>
Aug 01 12:17:19 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:17:19 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:17:19 user nova-compute[72178]:   <metadata>
Aug 01 12:17:19 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:17:19 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:17:19 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeTestJSON-server-1912286508</nova:name>
Aug 01 12:17:19 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:17:18</nova:creationTime>
Aug 01 12:17:19 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:17:19 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:17:19 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:17:19 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:17:19 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:17:19 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:17:19 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:17:19 user nova-compute[72178]:       <nova:owner>
Aug 01 12:17:19 user nova-compute[72178]:         <nova:user uuid="1158c8ff7efb465d9c7fdb7da7d22045">tempest-AttachVolumeTestJSON-236294761-project-member</nova:user>
Aug 01 12:17:19 user nova-compute[72178]:         <nova:project uuid="c5ca4acce2204173bad928ab3c58d053">tempest-AttachVolumeTestJSON-236294761</nova:project>
Aug 01 12:17:19 user nova-compute[72178]:       </nova:owner>
Aug 01 12:17:19 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:17:19 user nova-compute[72178]:       <nova:ports>
Aug 01 12:17:19 user nova-compute[72178]:         <nova:port uuid="e15e122f-e600-4d15-a508-998a84817013">
Aug 01 12:17:19 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 12:17:19 user nova-compute[72178]:         </nova:port>
Aug 01 12:17:19 user nova-compute[72178]:       </nova:ports>
Aug 01 12:17:19 user nova-compute[72178]:     </nova:instance>
Aug 01 12:17:19 user nova-compute[72178]:   </metadata>
Aug 01 12:17:19 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:17:19 user nova-compute[72178]:     <system>
Aug 01 12:17:19 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:17:19 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:17:19 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:17:19 user nova-compute[72178]:       <entry name="serial">6c816328-61df-4625-95e6-bc27fbd7148d</entry>
Aug 01 12:17:19 user nova-compute[72178]:       <entry name="uuid">6c816328-61df-4625-95e6-bc27fbd7148d</entry>
Aug 01 12:17:19 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:17:19 user nova-compute[72178]:     </system>
Aug 01 12:17:19 user nova-compute[72178]:   </sysinfo>
Aug 01 12:17:19 user nova-compute[72178]:   <os>
Aug 01 12:17:19 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:17:19 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:17:19 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:17:19 user nova-compute[72178]:   </os>
Aug 01 12:17:19 user nova-compute[72178]:   <features>
Aug 01 12:17:19 user nova-compute[72178]:     <acpi/>
Aug 01 12:17:19 user nova-compute[72178]:     <apic/>
Aug 01 12:17:19 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:17:19 user nova-compute[72178]:   </features>
Aug 01 12:17:19 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:17:19 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:17:19 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:17:19 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:17:19 user nova-compute[72178]:   </clock>
Aug 01 12:17:19 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:17:19 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:17:19 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:17:19 user nova-compute[72178]:   </cpu>
Aug 01 12:17:19 user nova-compute[72178]:   <devices>
Aug 01 12:17:19 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:17:19 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:17:19 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk"/>
Aug 01 12:17:19 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:17:19 user nova-compute[72178]:     </disk>
Aug 01 12:17:19 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:17:19 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:17:19 user nova-compute[72178]:       <source dev="/dev/sdd"/>
Aug 01 12:17:19 user nova-compute[72178]:       <target dev="vdb" bus="virtio"/>
Aug 01 12:17:19 user nova-compute[72178]:       <serial>99579ea8-a988-4a66-bd52-c38d5d003d34</serial>
Aug 01 12:17:19 user nova-compute[72178]:     </disk>
Aug 01 12:17:19 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:17:19 user nova-compute[72178]:       <mac address="fa:16:3e:de:3e:66"/>
Aug 01 12:17:19 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:17:19 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:17:19 user nova-compute[72178]:       <target dev="tape15e122f-e6"/>
Aug 01 12:17:19 user nova-compute[72178]:     </interface>
Aug 01 12:17:19 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:17:19 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/console.log" append="off"/>
Aug 01 12:17:19 user nova-compute[72178]:     </serial>
Aug 01 12:17:19 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:17:19 user nova-compute[72178]:     <video>
Aug 01 12:17:19 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:17:19 user nova-compute[72178]:     </video>
Aug 01 12:17:19 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:17:19 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:17:19 user nova-compute[72178]:     </rng>
Aug 01 12:17:19 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:17:19 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:17:19 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:17:19 user nova-compute[72178]:     </memballoon>
Aug 01 12:17:19 user nova-compute[72178]:   </devices>
Aug 01 12:17:19 user nova-compute[72178]: </domain>
Aug 01 12:17:19 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:19 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Cannot resize image /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'migration_context' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:15:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG os_vif [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape15e122f-e6, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape15e122f-e6, col_values=(('external_ids', {'iface-id': 'e15e122f-e600-4d15-a508-998a84817013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:3e:66', 'vm-uuid': '6c816328-61df-4625-95e6-bc27fbd7148d'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:17:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:20 user nova-compute[72178]: INFO os_vif [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6')
Aug 01 12:17:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-a97115f6-a1b6-4927-965a-b2b8e1709dcb req-c20d828c-a3b2-4a6f-a405-b2bd17ec259c service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a97115f6-a1b6-4927-965a-b2b8e1709dcb req-c20d828c-a3b2-4a6f-a405-b2bd17ec259c service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a97115f6-a1b6-4927-965a-b2b8e1709dcb req-c20d828c-a3b2-4a6f-a405-b2bd17ec259c service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a97115f6-a1b6-4927-965a-b2b8e1709dcb req-c20d828c-a3b2-4a6f-a405-b2bd17ec259c service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:21 user nova-compute[72178]: DEBUG nova.compute.manager [req-a97115f6-a1b6-4927-965a-b2b8e1709dcb req-c20d828c-a3b2-4a6f-a405-b2bd17ec259c service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:21 user nova-compute[72178]: WARNING nova.compute.manager [req-a97115f6-a1b6-4927-965a-b2b8e1709dcb req-c20d828c-a3b2-4a6f-a405-b2bd17ec259c service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state stopped and task_state powering-on.
Aug 01 12:17:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892243.84321, 6c816328-61df-4625-95e6-bc27fbd7148d => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:17:23 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Resumed (Lifecycle Event)
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:17:23 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance rebooted successfully.
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c36f6e1f-06af-4d4f-983b-565e4cadc598 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:17:23 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892243.8479836, 6c816328-61df-4625-95e6-bc27fbd7148d => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:17:23 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Started (Lifecycle Event)
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.compute.manager [req-941c5138-c029-4be5-bb91-7774a9295e75 req-f0672701-4a0e-4d29-b913-a88275ace8c2 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-941c5138-c029-4be5-bb91-7774a9295e75 req-f0672701-4a0e-4d29-b913-a88275ace8c2 service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-941c5138-c029-4be5-bb91-7774a9295e75 req-f0672701-4a0e-4d29-b913-a88275ace8c2 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-941c5138-c029-4be5-bb91-7774a9295e75 req-f0672701-4a0e-4d29-b913-a88275ace8c2 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:23 user nova-compute[72178]: DEBUG nova.compute.manager [req-941c5138-c029-4be5-bb91-7774a9295e75 req-f0672701-4a0e-4d29-b913-a88275ace8c2 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:23 user nova-compute[72178]: WARNING nova.compute.manager [req-941c5138-c029-4be5-bb91-7774a9295e75 req-f0672701-4a0e-4d29-b913-a88275ace8c2 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state active and task_state None.
Aug 01 12:17:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:17:29 user nova-compute[72178]: INFO nova.compute.claims [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Claim successful on node user
Aug 01 12:17:29 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:17:29 user nova-compute[72178]: DEBUG nova.network.neutron [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:17:29 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:17:29 user nova-compute[72178]: DEBUG nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.policy [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd81d3a10a4819a414d5a61a9d6056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874d88ce21b743e195c696aaa7195ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:17:30 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Creating image(s)
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "/opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "/opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk 1073741824" returned: 0 in 0.054s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Cannot resize image /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.objects.instance [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'migration_context' on Instance uuid 5b81c686-411a-4d3a-86da-4089747b1441 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Ensure instance console log exists: /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:30 user nova-compute[72178]: DEBUG nova.network.neutron [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Successfully created port: 554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Successfully updated port: 554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquired lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-65300cf3-ea11-41aa-94ab-507ed8c9fd4a req-c0128787-60d8-47cb-9948-a97323f96bfe service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received event network-changed-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.compute.manager [req-65300cf3-ea11-41aa-94ab-507ed8c9fd4a req-c0128787-60d8-47cb-9948-a97323f96bfe service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Refreshing instance network info cache due to event network-changed-554ca614-c20e-47aa-a828-c58f9c155992. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-65300cf3-ea11-41aa-94ab-507ed8c9fd4a req-c0128787-60d8-47cb-9948-a97323f96bfe service nova] Acquiring lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.neutron [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Updating instance_info_cache with network_info: [{"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Releasing lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Instance network_info: |[{"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-65300cf3-ea11-41aa-94ab-507ed8c9fd4a req-c0128787-60d8-47cb-9948-a97323f96bfe service nova] Acquired lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.neutron [req-65300cf3-ea11-41aa-94ab-507ed8c9fd4a req-c0128787-60d8-47cb-9948-a97323f96bfe service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Refreshing network info cache for port 554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Start _get_guest_xml network_info=[{"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:17:32 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:17:32 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1099733893',display_name='tempest-AttachVolumeNegativeTest-server-1099733893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1099733893',id=40,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgpB8jr/c5uqEqkt3AR2Mxyauug20C2DGs6C2ofiwWpcv/JQChu0TePDU2xZrWmjhoZka7c9KkWNEyQujZOaWV4IsagHuc0Sd4KGQQsApjow4ZXuOBzXAxjfl6o726o+Q==',key_name='tempest-keypair-1048518203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-s7piiope',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=5b81c686-411a-4d3a-86da-4089747b1441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:1b:05,bridge_name='br-int',has_traffic_filtering=True,id=554ca614-c20e-47aa-a828-c58f9c155992,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554ca614-c2') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.objects.instance [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b81c686-411a-4d3a-86da-4089747b1441 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:17:32 user nova-compute[72178]:   <uuid>5b81c686-411a-4d3a-86da-4089747b1441</uuid>
Aug 01 12:17:32 user nova-compute[72178]:   <name>instance-00000028</name>
Aug 01 12:17:32 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:17:32 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:17:32 user nova-compute[72178]:   <metadata>
Aug 01 12:17:32 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:17:32 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:17:32 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1099733893</nova:name>
Aug 01 12:17:32 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:17:32</nova:creationTime>
Aug 01 12:17:32 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:17:32 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:17:32 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:17:32 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:17:32 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:17:32 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:17:32 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:17:32 user nova-compute[72178]:       <nova:owner>
Aug 01 12:17:32 user nova-compute[72178]:         <nova:user uuid="73fd81d3a10a4819a414d5a61a9d6056">tempest-AttachVolumeNegativeTest-1677263646-project-member</nova:user>
Aug 01 12:17:32 user nova-compute[72178]:         <nova:project uuid="874d88ce21b743e195c696aaa7195ffc">tempest-AttachVolumeNegativeTest-1677263646</nova:project>
Aug 01 12:17:32 user nova-compute[72178]:       </nova:owner>
Aug 01 12:17:32 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:17:32 user nova-compute[72178]:       <nova:ports>
Aug 01 12:17:32 user nova-compute[72178]:         <nova:port uuid="554ca614-c20e-47aa-a828-c58f9c155992">
Aug 01 12:17:32 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 12:17:32 user nova-compute[72178]:         </nova:port>
Aug 01 12:17:32 user nova-compute[72178]:       </nova:ports>
Aug 01 12:17:32 user nova-compute[72178]:     </nova:instance>
Aug 01 12:17:32 user nova-compute[72178]:   </metadata>
Aug 01 12:17:32 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:17:32 user nova-compute[72178]:     <system>
Aug 01 12:17:32 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:17:32 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:17:32 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:17:32 user nova-compute[72178]:       <entry name="serial">5b81c686-411a-4d3a-86da-4089747b1441</entry>
Aug 01 12:17:32 user nova-compute[72178]:       <entry name="uuid">5b81c686-411a-4d3a-86da-4089747b1441</entry>
Aug 01 12:17:32 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:17:32 user nova-compute[72178]:     </system>
Aug 01 12:17:32 user nova-compute[72178]:   </sysinfo>
Aug 01 12:17:32 user nova-compute[72178]:   <os>
Aug 01 12:17:32 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:17:32 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:17:32 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:17:32 user nova-compute[72178]:   </os>
Aug 01 12:17:32 user nova-compute[72178]:   <features>
Aug 01 12:17:32 user nova-compute[72178]:     <acpi/>
Aug 01 12:17:32 user nova-compute[72178]:     <apic/>
Aug 01 12:17:32 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:17:32 user nova-compute[72178]:   </features>
Aug 01 12:17:32 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:17:32 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:17:32 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:17:32 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:17:32 user nova-compute[72178]:   </clock>
Aug 01 12:17:32 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:17:32 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:17:32 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:17:32 user nova-compute[72178]:   </cpu>
Aug 01 12:17:32 user nova-compute[72178]:   <devices>
Aug 01 12:17:32 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:17:32 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:17:32 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk"/>
Aug 01 12:17:32 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:17:32 user nova-compute[72178]:     </disk>
Aug 01 12:17:32 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:17:32 user nova-compute[72178]:       <mac address="fa:16:3e:53:1b:05"/>
Aug 01 12:17:32 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:17:32 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:17:32 user nova-compute[72178]:       <target dev="tap554ca614-c2"/>
Aug 01 12:17:32 user nova-compute[72178]:     </interface>
Aug 01 12:17:32 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:17:32 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/console.log" append="off"/>
Aug 01 12:17:32 user nova-compute[72178]:     </serial>
Aug 01 12:17:32 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:17:32 user nova-compute[72178]:     <video>
Aug 01 12:17:32 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:17:32 user nova-compute[72178]:     </video>
Aug 01 12:17:32 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:17:32 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:17:32 user nova-compute[72178]:     </rng>
Aug 01 12:17:32 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:17:32 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:17:32 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:17:32 user nova-compute[72178]:     </memballoon>
Aug 01 12:17:32 user nova-compute[72178]:   </devices>
Aug 01 12:17:32 user nova-compute[72178]: </domain>
Aug 01 12:17:32 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1099733893',display_name='tempest-AttachVolumeNegativeTest-server-1099733893',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1099733893',id=40,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgpB8jr/c5uqEqkt3AR2Mxyauug20C2DGs6C2ofiwWpcv/JQChu0TePDU2xZrWmjhoZka7c9KkWNEyQujZOaWV4IsagHuc0Sd4KGQQsApjow4ZXuOBzXAxjfl6o726o+Q==',key_name='tempest-keypair-1048518203',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-s7piiope',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:17:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=5b81c686-411a-4d3a-86da-4089747b1441,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:1b:05,bridge_name='br-int',has_traffic_filtering=True,id=554ca614-c20e-47aa-a828-c58f9c155992,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554ca614-c2') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG os_vif [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:1b:05,bridge_name='br-int',has_traffic_filtering=True,id=554ca614-c20e-47aa-a828-c58f9c155992,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554ca614-c2') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap554ca614-c2, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap554ca614-c2, col_values=(('external_ids', {'iface-id': '554ca614-c20e-47aa-a828-c58f9c155992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:1b:05', 'vm-uuid': '5b81c686-411a-4d3a-86da-4089747b1441'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:32 user nova-compute[72178]: INFO os_vif [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:1b:05,bridge_name='br-int',has_traffic_filtering=True,id=554ca614-c20e-47aa-a828-c58f9c155992,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554ca614-c2')
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:17:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No VIF found with MAC fa:16:3e:53:1b:05, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:17:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-65300cf3-ea11-41aa-94ab-507ed8c9fd4a req-c0128787-60d8-47cb-9948-a97323f96bfe service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Updated VIF entry in instance network info cache for port 554ca614-c20e-47aa-a828-c58f9c155992. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:17:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-65300cf3-ea11-41aa-94ab-507ed8c9fd4a req-c0128787-60d8-47cb-9948-a97323f96bfe service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Updating instance_info_cache with network_info: [{"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:17:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-65300cf3-ea11-41aa-94ab-507ed8c9fd4a req-c0128787-60d8-47cb-9948-a97323f96bfe service nova] Releasing lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:17:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-90d5cf30-6707-4e41-bfac-b58219a84b50 req-fb94f690-cb6c-49aa-a869-3c009055ca6c service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received event network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-90d5cf30-6707-4e41-bfac-b58219a84b50 req-fb94f690-cb6c-49aa-a869-3c009055ca6c service nova] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-90d5cf30-6707-4e41-bfac-b58219a84b50 req-fb94f690-cb6c-49aa-a869-3c009055ca6c service nova] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-90d5cf30-6707-4e41-bfac-b58219a84b50 req-fb94f690-cb6c-49aa-a869-3c009055ca6c service nova] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-90d5cf30-6707-4e41-bfac-b58219a84b50 req-fb94f690-cb6c-49aa-a869-3c009055ca6c service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] No waiting events found dispatching network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:34 user nova-compute[72178]: WARNING nova.compute.manager [req-90d5cf30-6707-4e41-bfac-b58219a84b50 req-fb94f690-cb6c-49aa-a869-3c009055ca6c service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received unexpected event network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 for instance with vm_state building and task_state spawning.
Aug 01 12:17:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-79e6ca34-34e8-4778-bfc8-41c56bd128ef req-2ca96f58-216f-45fc-a877-23cade7e01eb service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received event network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-79e6ca34-34e8-4778-bfc8-41c56bd128ef req-2ca96f58-216f-45fc-a877-23cade7e01eb service nova] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-79e6ca34-34e8-4778-bfc8-41c56bd128ef req-2ca96f58-216f-45fc-a877-23cade7e01eb service nova] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-79e6ca34-34e8-4778-bfc8-41c56bd128ef req-2ca96f58-216f-45fc-a877-23cade7e01eb service nova] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-79e6ca34-34e8-4778-bfc8-41c56bd128ef req-2ca96f58-216f-45fc-a877-23cade7e01eb service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] No waiting events found dispatching network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:36 user nova-compute[72178]: WARNING nova.compute.manager [req-79e6ca34-34e8-4778-bfc8-41c56bd128ef req-2ca96f58-216f-45fc-a877-23cade7e01eb service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received unexpected event network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 for instance with vm_state building and task_state spawning.
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892256.79367, 5b81c686-411a-4d3a-86da-4089747b1441 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:17:36 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] VM Resumed (Lifecycle Event)
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:17:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Instance spawned successfully.
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:17:36 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892256.795958, 5b81c686-411a-4d3a-86da-4089747b1441 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:17:36 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] VM Started (Lifecycle Event)
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:17:36 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:17:36 user nova-compute[72178]: INFO nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Took 6.80 seconds to spawn the instance on the hypervisor.
Aug 01 12:17:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:37 user nova-compute[72178]: INFO nova.compute.manager [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Took 7.64 seconds to build instance.
Aug 01 12:17:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-93869f3f-761f-49f1-a11b-961618f84ce6 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.758s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:17:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:17:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:17:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:17:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating instance_info_cache with network_info: [{"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-febae49f-2d0b-4f28-a695-0ecaaf120077" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:43 user nova-compute[72178]: INFO nova.compute.manager [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Terminating instance
Aug 01 12:17:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e3a3e9b-7c9b-4c1b-8679-d73d48f1d2f7 req-edd25c2e-6653-4aff-9a2d-9c2f53e3cf6b service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e3a3e9b-7c9b-4c1b-8679-d73d48f1d2f7 req-edd25c2e-6653-4aff-9a2d-9c2f53e3cf6b service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e3a3e9b-7c9b-4c1b-8679-d73d48f1d2f7 req-edd25c2e-6653-4aff-9a2d-9c2f53e3cf6b service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e3a3e9b-7c9b-4c1b-8679-d73d48f1d2f7 req-edd25c2e-6653-4aff-9a2d-9c2f53e3cf6b service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e3a3e9b-7c9b-4c1b-8679-d73d48f1d2f7 req-edd25c2e-6653-4aff-9a2d-9c2f53e3cf6b service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e3a3e9b-7c9b-4c1b-8679-d73d48f1d2f7 req-edd25c2e-6653-4aff-9a2d-9c2f53e3cf6b service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-unplugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:44 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Instance destroyed successfully.
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'resources' on Instance uuid d3870f4a-ea47-4075-b342-2b20cfa749f9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-280081968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-280081968',id=14,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:03:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-js1gllif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:05:40Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=d3870f4a-ea47-4075-b342-2b20cfa749f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "address": "fa:16:3e:d8:e0:4a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7d6253a-cf", "ovs_interfaceid": "b7d6253a-cf03-47ad-8398-2a9c13e58116", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=b7d6253a-cf03-47ad-8398-2a9c13e58116,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d6253a-cf') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_vif [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=b7d6253a-cf03-47ad-8398-2a9c13e58116,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d6253a-cf') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7d6253a-cf, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:44 user nova-compute[72178]: INFO os_vif [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e0:4a,bridge_name='br-int',has_traffic_filtering=True,id=b7d6253a-cf03-47ad-8398-2a9c13e58116,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7d6253a-cf')
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tKHUevhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:17:44 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f72bf63-d17d-4144-8bbc-f7f1c1b6ab69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b3753e31-7ba7-4162-aa32-eecef1b5f6d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7462f6b-3697-4fb2-8461-1c69092e4f62]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3753e31-7ba7-4162-aa32-eecef1b5f6d9 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:44 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:44 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:44 user nova-compute[72178]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3753e31-7ba7-4162-aa32-eecef1b5f6d9 (non-flash)
Aug 01 12:17:44 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c (non-flash)
Aug 01 12:17:44 user nova-compute[72178]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:17:44 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:17:44 user nova-compute[72178]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b3753e31-7ba7-4162-aa32-eecef1b5f6d9 (non-flash)
Aug 01 12:17:44 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f4516950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c'): ({'sdb'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Removing single pathed devices sdb {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd3cb4-f363-4d6e-81ec-128d2cba20f3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4c704c-c939-41bc-afe8-05fe657fc772]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Flushing IO for device /dev/sdb {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[237a72fe-ecd4-4e0f-86b8-8f417db41dcf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53d760d-6061-4941-b669-de874717010e]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[577a309f-9e1d-42f8-9dd3-2fc433bceaac]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7be01c-219e-4d06-af9f-4cd607390a2d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c, portal: 172.16.0.220,3260]
Aug 01 12:17:44 user nova-compute[72178]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c, portal: 172.16.0.220,3260] successful.
Aug 01 12:17:44 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bed47c42-bdf4-47ca-8963-50ec3e68e25c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ff1df-372a-4e2a-b317-f9898666603b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] <== disconnect_volume: return (350ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:17:44 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Deleting instance files /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9_del
Aug 01 12:17:44 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Deletion of /opt/stack/data/nova/instances/d3870f4a-ea47-4075-b342-2b20cfa749f9_del complete
Aug 01 12:17:44 user nova-compute[72178]: INFO nova.compute.manager [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Took 1.31 seconds to destroy the instance on the hypervisor.
Aug 01 12:17:44 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:17:44 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:17:45 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Took 0.81 seconds to deallocate network for instance.
Aug 01 12:17:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-60ca1864-55de-4f1e-bcfb-ac9af7498008 req-fddfdb38-ffd6-4b13-a35b-a580a3ba904c service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-deleted-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-de3c90f3-fc45-42cc-b555-5f4428e9d4c2 req-883b236e-8cb9-442c-a6aa-8c5dfd52b79a service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3c90f3-fc45-42cc-b555-5f4428e9d4c2 req-883b236e-8cb9-442c-a6aa-8c5dfd52b79a service nova] Acquiring lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3c90f3-fc45-42cc-b555-5f4428e9d4c2 req-883b236e-8cb9-442c-a6aa-8c5dfd52b79a service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-de3c90f3-fc45-42cc-b555-5f4428e9d4c2 req-883b236e-8cb9-442c-a6aa-8c5dfd52b79a service nova] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-de3c90f3-fc45-42cc-b555-5f4428e9d4c2 req-883b236e-8cb9-442c-a6aa-8c5dfd52b79a service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] No waiting events found dispatching network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:46 user nova-compute[72178]: WARNING nova.compute.manager [req-de3c90f3-fc45-42cc-b555-5f4428e9d4c2 req-883b236e-8cb9-442c-a6aa-8c5dfd52b79a service nova] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Received unexpected event network-vif-plugged-b7d6253a-cf03-47ad-8398-2a9c13e58116 for instance with vm_state active and task_state deleting.
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:46 user nova-compute[72178]: INFO nova.compute.manager [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Terminating instance
Aug 01 12:17:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:46 user nova-compute[72178]: INFO nova.compute.manager [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Took 1.07 seconds to detach 1 volumes for instance.
Aug 01 12:17:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-ca1e64d9-e7c5-444d-a2b8-93d23cb07b4e req-eae2f90f-3ca9-4500-844c-ed29515ef985 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-unplugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ca1e64d9-e7c5-444d-a2b8-93d23cb07b4e req-eae2f90f-3ca9-4500-844c-ed29515ef985 service nova] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ca1e64d9-e7c5-444d-a2b8-93d23cb07b4e req-eae2f90f-3ca9-4500-844c-ed29515ef985 service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ca1e64d9-e7c5-444d-a2b8-93d23cb07b4e req-eae2f90f-3ca9-4500-844c-ed29515ef985 service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-ca1e64d9-e7c5-444d-a2b8-93d23cb07b4e req-eae2f90f-3ca9-4500-844c-ed29515ef985 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] No waiting events found dispatching network-vif-unplugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-ca1e64d9-e7c5-444d-a2b8-93d23cb07b4e req-eae2f90f-3ca9-4500-844c-ed29515ef985 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-unplugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:47 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Instance destroyed successfully.
Aug 01 12:17:47 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lazy-loading 'resources' on Instance uuid c4621d07-791b-49da-97b3-aa8558914e7b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:12:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1596342614',display_name='tempest-TestMinimumBasicScenario-server-1596342614',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1596342614',id=33,image_ref='566363a5-aae5-423c-90bd-818acdb0ba60',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOq6dGsc8YTSokjQNBcdV2EswuFBDTwAaZU1yqcCT9xbGBTFZmiIb0uMthO9tIWuyq0AFUUgX9w43SsAxeRTwtti98fxbXtEmiibpUJrVuPjoAY7qAryoAfikZqg7TPODg==',key_name='tempest-TestMinimumBasicScenario-1623450736',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:12:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9aad2b5a65c4d8b8cdacafe727db4e3',ramdisk_id='',reservation_id='r-9wzta6ra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='566363a5-aae5-423c-90bd-818acdb0ba60',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1575364257',owner_user_name='tempest-TestMinimumBasicScenario-1575364257-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:15:05Z,user_data=None,user_id='a5decc5e0a6b442c8ae65673dc854985',uuid=c4621d07-791b-49da-97b3-aa8558914e7b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converting VIF {"id": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "address": "fa:16:3e:1c:b7:43", "network": {"id": "e57fd2c9-0ead-4818-b022-73dd43b95986", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1954176697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9aad2b5a65c4d8b8cdacafe727db4e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0afb8c-17", "ovs_interfaceid": "4d0afb8c-1700-4680-b0cf-4f19ce23d15e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b7:43,bridge_name='br-int',has_traffic_filtering=True,id=4d0afb8c-1700-4680-b0cf-4f19ce23d15e,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0afb8c-17') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG os_vif [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b7:43,bridge_name='br-int',has_traffic_filtering=True,id=4d0afb8c-1700-4680-b0cf-4f19ce23d15e,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0afb8c-17') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d0afb8c-17, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:17:47 user nova-compute[72178]: INFO os_vif [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b7:43,bridge_name='br-int',has_traffic_filtering=True,id=4d0afb8c-1700-4680-b0cf-4f19ce23d15e,network=Network(e57fd2c9-0ead-4818-b022-73dd43b95986),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0afb8c-17')
Aug 01 12:17:47 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Deleting instance files /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b_del
Aug 01 12:17:47 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Deletion of /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b_del complete
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json" returned: 1 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk --force-share --output=json' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:17:47 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000021, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/c4621d07-791b-49da-97b3-aa8558914e7b/disk
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:47 user nova-compute[72178]: INFO nova.compute.manager [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.630s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:47 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Deleted allocations for instance d3870f4a-ea47-4075-b342-2b20cfa749f9
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2daf236-5765-45c2-9d1b-30e7199717ba tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "d3870f4a-ea47-4075-b342-2b20cfa749f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.144s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:17:48 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Took 0.67 seconds to deallocate network for instance.
Aug 01 12:17:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-ab2f2027-19b9-45ac-b29a-efd315e9099c req-ea305268-fac5-47ff-b48b-324c249602a2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-deleted-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:48 user nova-compute[72178]: INFO nova.compute.manager [req-ab2f2027-19b9-45ac-b29a-efd315e9099c req-ea305268-fac5-47ff-b48b-324c249602a2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Neutron deleted interface 4d0afb8c-1700-4680-b0cf-4f19ce23d15e; detaching it from the instance and deleting it from the info cache
Aug 01 12:17:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-ab2f2027-19b9-45ac-b29a-efd315e9099c req-ea305268-fac5-47ff-b48b-324c249602a2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-ab2f2027-19b9-45ac-b29a-efd315e9099c req-ea305268-fac5-47ff-b48b-324c249602a2 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Detach interface failed, port_id=4d0afb8c-1700-4680-b0cf-4f19ce23d15e, reason: Instance c4621d07-791b-49da-97b3-aa8558914e7b could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:17:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:17:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:17:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7600MB free_disk=25.058509826660156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.351s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-cfe0b82d-97ad-4291-adb7-1c098490af6f req-e845338b-6a2e-465b-9629-f8c738a6e140 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cfe0b82d-97ad-4291-adb7-1c098490af6f req-e845338b-6a2e-465b-9629-f8c738a6e140 service nova] Acquiring lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cfe0b82d-97ad-4291-adb7-1c098490af6f req-e845338b-6a2e-465b-9629-f8c738a6e140 service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cfe0b82d-97ad-4291-adb7-1c098490af6f req-e845338b-6a2e-465b-9629-f8c738a6e140 service nova] Lock "c4621d07-791b-49da-97b3-aa8558914e7b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-cfe0b82d-97ad-4291-adb7-1c098490af6f req-e845338b-6a2e-465b-9629-f8c738a6e140 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] No waiting events found dispatching network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:49 user nova-compute[72178]: WARNING nova.compute.manager [req-cfe0b82d-97ad-4291-adb7-1c098490af6f req-e845338b-6a2e-465b-9629-f8c738a6e140 service nova] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Received unexpected event network-vif-plugged-4d0afb8c-1700-4680-b0cf-4f19ce23d15e for instance with vm_state deleted and task_state None.
Aug 01 12:17:49 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Deleted allocations for instance c4621d07-791b-49da-97b3-aa8558914e7b
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5f720460-477f-472a-904b-7a8c82bca76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance febae49f-2d0b-4f28-a695-0ecaaf120077 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f83a6749-76c7-4af7-b72d-9bc3d4d4cab9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5b81c686-411a-4d3a-86da-4089747b1441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:17:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6426aeb7-09d9-4c63-9add-8010a355f9e2 tempest-TestMinimumBasicScenario-1575364257 tempest-TestMinimumBasicScenario-1575364257-project-member] Lock "c4621d07-791b-49da-97b3-aa8558914e7b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.380s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:50 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:17:50 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:17:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:17:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.838s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:57 user nova-compute[72178]: INFO nova.compute.manager [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Terminating instance
Aug 01 12:17:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:17:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-05301cb0-0172-4c16-8e86-2041a06208a1 req-f567a8f6-a8be-4548-80b2-7ee4c10ea31e service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received event network-vif-unplugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-05301cb0-0172-4c16-8e86-2041a06208a1 req-f567a8f6-a8be-4548-80b2-7ee4c10ea31e service nova] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-05301cb0-0172-4c16-8e86-2041a06208a1 req-f567a8f6-a8be-4548-80b2-7ee4c10ea31e service nova] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-05301cb0-0172-4c16-8e86-2041a06208a1 req-f567a8f6-a8be-4548-80b2-7ee4c10ea31e service nova] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-05301cb0-0172-4c16-8e86-2041a06208a1 req-f567a8f6-a8be-4548-80b2-7ee4c10ea31e service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] No waiting events found dispatching network-vif-unplugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.compute.manager [req-05301cb0-0172-4c16-8e86-2041a06208a1 req-f567a8f6-a8be-4548-80b2-7ee4c10ea31e service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received event network-vif-unplugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892264.438318, d3870f4a-ea47-4075-b342-2b20cfa749f9 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:17:59 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] VM Stopped (Lifecycle Event)
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-720390f5-ee60-408f-8ff7-1cc433ac9451 None None] [instance: d3870f4a-ea47-4075-b342-2b20cfa749f9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:17:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Instance destroyed successfully.
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lazy-loading 'resources' on Instance uuid febae49f-2d0b-4f28-a695-0ecaaf120077 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-571208767',display_name='tempest-SnapshotDataIntegrityTests-server-571208767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-571208767',id=29,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7+PjH7LyGgcx0Uts+/yvjjSKORVxZyd3kbqmtlqMexU2XC+uZhKAPeswgoZYA96ss4RXiwm76fkLQCZcAEfNgOoPmRZPNuy4s/wFKEnWzrGXtJYSBWN7mOXWFMMS8xtA==',key_name='tempest-keypair-1164477765',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:10:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090b100be3a14016b833d5b3dff49531',ramdisk_id='',reservation_id='r-0nblgvgz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2016174200',owner_user_name='tempest-SnapshotDataIntegrityTests-2016174200-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f7d61300ab4d46fd81eb101da4aac46d',uuid=febae49f-2d0b-4f28-a695-0ecaaf120077,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Converting VIF {"id": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "address": "fa:16:3e:d2:93:c8", "network": {"id": "67aad9d3-8a4f-445a-a940-7cbe49c23662", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-712544083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090b100be3a14016b833d5b3dff49531", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ed79e30-ec", "ovs_interfaceid": "8ed79e30-ec8c-4ab4-9447-738d5d07cdbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=8ed79e30-ec8c-4ab4-9447-738d5d07cdbc,network=Network(67aad9d3-8a4f-445a-a940-7cbe49c23662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ed79e30-ec') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG os_vif [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=8ed79e30-ec8c-4ab4-9447-738d5d07cdbc,network=Network(67aad9d3-8a4f-445a-a940-7cbe49c23662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ed79e30-ec') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ed79e30-ec, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:17:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:17:59 user nova-compute[72178]: INFO os_vif [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:93:c8,bridge_name='br-int',has_traffic_filtering=True,id=8ed79e30-ec8c-4ab4-9447-738d5d07cdbc,network=Network(67aad9d3-8a4f-445a-a940-7cbe49c23662),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ed79e30-ec')
Aug 01 12:17:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Deleting instance files /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077_del
Aug 01 12:17:59 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Deletion of /opt/stack/data/nova/instances/febae49f-2d0b-4f28-a695-0ecaaf120077_del complete
Aug 01 12:18:01 user nova-compute[72178]: INFO nova.compute.manager [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Took 3.05 seconds to destroy the instance on the hypervisor.
Aug 01 12:18:01 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:18:01 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:18:01 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:18:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-170bbe6b-fceb-4752-a823-41ccf0d66050 req-916df6c7-b151-4117-8a68-ee08e0d29b06 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received event network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-170bbe6b-fceb-4752-a823-41ccf0d66050 req-916df6c7-b151-4117-8a68-ee08e0d29b06 service nova] Acquiring lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-170bbe6b-fceb-4752-a823-41ccf0d66050 req-916df6c7-b151-4117-8a68-ee08e0d29b06 service nova] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-170bbe6b-fceb-4752-a823-41ccf0d66050 req-916df6c7-b151-4117-8a68-ee08e0d29b06 service nova] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-170bbe6b-fceb-4752-a823-41ccf0d66050 req-916df6c7-b151-4117-8a68-ee08e0d29b06 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] No waiting events found dispatching network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:18:01 user nova-compute[72178]: WARNING nova.compute.manager [req-170bbe6b-fceb-4752-a823-41ccf0d66050 req-916df6c7-b151-4117-8a68-ee08e0d29b06 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received unexpected event network-vif-plugged-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc for instance with vm_state active and task_state deleting.
Aug 01 12:18:02 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892267.1818676, c4621d07-791b-49da-97b3-aa8558914e7b => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:18:02 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] VM Stopped (Lifecycle Event)
Aug 01 12:18:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5960841-91cd-4cbd-aae3-7fc975d65b51 None None] [instance: c4621d07-791b-49da-97b3-aa8558914e7b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:18:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:02 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:18:02 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Took 1.42 seconds to deallocate network for instance.
Aug 01 12:18:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa3cc840-23b0-4e56-beda-5c4a0408c62f req-a1544993-5192-4005-864c-37c57905d764 service nova] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Received event network-vif-deleted-8ed79e30-ec8c-4ab4-9447-738d5d07cdbc {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:02 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:18:02 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:18:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:02 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Deleted allocations for instance febae49f-2d0b-4f28-a695-0ecaaf120077
Aug 01 12:18:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d38c66bc-7f7b-4603-9e89-ec8cbff54011 tempest-SnapshotDataIntegrityTests-2016174200 tempest-SnapshotDataIntegrityTests-2016174200-project-member] Lock "febae49f-2d0b-4f28-a695-0ecaaf120077" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.919s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-b975268f-cc21-4963-bd54-35141f7698b7 req-4cfaf8b3-02e8-4237-967a-bf67485dca4d service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-changed-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG nova.compute.manager [req-b975268f-cc21-4963-bd54-35141f7698b7 req-4cfaf8b3-02e8-4237-967a-bf67485dca4d service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Refreshing instance network info cache due to event network-changed-4aea2bba-76d8-441e-a325-eccd19b2194f. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b975268f-cc21-4963-bd54-35141f7698b7 req-4cfaf8b3-02e8-4237-967a-bf67485dca4d service nova] Acquiring lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b975268f-cc21-4963-bd54-35141f7698b7 req-4cfaf8b3-02e8-4237-967a-bf67485dca4d service nova] Acquired lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG nova.network.neutron [req-b975268f-cc21-4963-bd54-35141f7698b7 req-4cfaf8b3-02e8-4237-967a-bf67485dca4d service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Refreshing network info cache for port 4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:08 user nova-compute[72178]: DEBUG nova.objects.instance [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'flavor' on Instance uuid f0ef243f-6c58-4991-97b1-0883d24dd6c9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-b975268f-cc21-4963-bd54-35141f7698b7 req-4cfaf8b3-02e8-4237-967a-bf67485dca4d service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updated VIF entry in instance network info cache for port 4aea2bba-76d8-441e-a325-eccd19b2194f. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG nova.network.neutron [req-b975268f-cc21-4963-bd54-35141f7698b7 req-4cfaf8b3-02e8-4237-967a-bf67485dca4d service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updating instance_info_cache with network_info: [{"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b975268f-cc21-4963-bd54-35141f7698b7 req-4cfaf8b3-02e8-4237-967a-bf67485dca4d service nova] Releasing lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:09 user nova-compute[72178]: INFO nova.compute.manager [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Attaching volume b23d85f6-b570-4ea8-a8b1-571bb31ab680 to /dev/vdb
Aug 01 12:18:09 user nova-compute[72178]: DEBUG os_brick.utils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7c1570-5610-45c6-b6b4-9245fa935761]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c80c41-0784-4701-80de-dacd83cd8e78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[693445c3-fdde-4400-9af9-9863d897d633]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff3352-c1a2-4a06-b703-b355bf0c3fc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:18:09 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:18:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05f51a6-e843-4cc7-b078-20776a870f38]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG os_brick.utils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updating existing volume attachment record: d2b3b197-e216-459c-a5b5-236ce6d05454 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:18:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:14 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892279.5881677, febae49f-2d0b-4f28-a695-0ecaaf120077 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:18:14 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] VM Stopped (Lifecycle Event)
Aug 01 12:18:14 user nova-compute[72178]: DEBUG nova.compute.manager [None req-5586c989-6f04-4050-86f2-38e94459e251 None None] [instance: febae49f-2d0b-4f28-a695-0ecaaf120077] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:18:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tileGSKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:18:16 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:18:16 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:18:16 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc83704-3348-46ec-81f2-42fd28947e85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:18:16 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a829cd-b2b0-47fa-9795-3c45a490c63b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680] added
Aug 01 12:18:16 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[175281b9-b381-48b9-bb39-5de1d6955daf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4003c405-95b7-4d06-80bb-22a21dbb2532]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tileGSKb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tileGSKb" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[446a4175-23d4-4ee5-88f5-24c97c654202]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tileGSKb'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcd77c1-bbed-4b22-99cc-e26d13d973da]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a06031-4477-483e-bfe7-061ccc9469c1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:18:16 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:18:16 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:18:16 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:18:16 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[16854e31-0bbc-4ced-a688-94e19a7f8296]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680, portal: 172.16.0.220,3260]
Aug 01 12:18:16 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680, portal: 172.16.0.220,3260] successful.
Aug 01 12:18:16 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e73a71-ed66-4e35-ab71-830217a100ed]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39953bf-6c45-457b-b064-418f4c0413c0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:18:16 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:18:16 user nova-compute[72178]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 (non-flash)
Aug 01 12:18:16 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:18:16 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:18:16 user nova-compute[72178]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 (non-flash)
Aug 01 12:18:16 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3deef39b-99d6-4572-ad16-53957d775e1d]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:18:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tileGSKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:18:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:18:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23461373938386235', 'path': '/dev/sdb'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:18:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461373938386235', 'path': '/dev/sdb'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:18:17 user nova-compute[72178]: DEBUG nova.objects.instance [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'flavor' on Instance uuid f0ef243f-6c58-4991-97b1-0883d24dd6c9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:18:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:18:17 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:18:17 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:18:17 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:18:17 user nova-compute[72178]:   <serial>b23d85f6-b570-4ea8-a8b1-571bb31ab680</serial>
Aug 01 12:18:17 user nova-compute[72178]: </disk>
Aug 01 12:18:17 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:18:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:18:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:18:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No VIF found with MAC fa:16:3e:ed:5a:ba, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:18:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-2848c976-df2d-4cf7-b7e9-d75c5bc134b5 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.235s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:20 user nova-compute[72178]: INFO nova.compute.manager [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Detaching volume b23d85f6-b570-4ea8-a8b1-571bb31ab680
Aug 01 12:18:20 user nova-compute[72178]: INFO nova.virt.block_device [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Attempting to driver detach volume b23d85f6-b570-4ea8-a8b1-571bb31ab680 from mountpoint /dev/vdb
Aug 01 12:18:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Attempting to detach device vdb from instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:18:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:18:20 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:18:20 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:18:20 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:18:20 user nova-compute[72178]:   <serial>b23d85f6-b570-4ea8-a8b1-571bb31ab680</serial>
Aug 01 12:18:20 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:18:20 user nova-compute[72178]: </disk>
Aug 01 12:18:20 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:18:20 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Successfully detached device vdb from instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 from the persistent domain config.
Aug 01 12:18:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:18:20 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:18:20 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:18:20 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:18:20 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:18:20 user nova-compute[72178]:   <serial>b23d85f6-b570-4ea8-a8b1-571bb31ab680</serial>
Aug 01 12:18:20 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:18:20 user nova-compute[72178]: </disk>
Aug 01 12:18:20 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892301.053896, f0ef243f-6c58-4991-97b1-0883d24dd6c9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:18:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Successfully detached device vdb from instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 from the live domain config.
Aug 01 12:18:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tileGSKb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:18:21 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6e9ec2-0b24-446e-b33f-7fd65012ce12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[867203e7-fccd-4c10-af7b-f88392983003]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:18:21 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:18:21 user nova-compute[72178]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 (non-flash)
Aug 01 12:18:21 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:18:21 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:18:21 user nova-compute[72178]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 (non-flash)
Aug 01 12:18:21 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040d1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680'): ({'sdb'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Removing single pathed devices sdb {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c38a37e-3159-4543-ab2c-9b0aae48e48a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[91780028-6ec9-43da-953c-5d9a87cba7c8]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Flushing IO for device /dev/sdb {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20d5f54-c0b4-4cbd-a8d5-4185433d23cb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1835b6-bc1d-4614-95b0-ce01295316d4]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eac725-0cd5-4f50-ae1b-0a29ca1504bf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a835243-e3cc-44c2-b216-be42562e4af5]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680, portal: 172.16.0.220,3260]
Aug 01 12:18:21 user nova-compute[72178]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680, portal: 172.16.0.220,3260] successful.
Aug 01 12:18:21 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b23d85f6-b570-4ea8-a8b1-571bb31ab680 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b6af05-e4fd-44f4-8b04-b9527500f2c5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] <== disconnect_volume: return (279ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:18:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:18:22 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'flavor' on Instance uuid f0ef243f-6c58-4991-97b1-0883d24dd6c9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:18:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8bd5cc1b-2c4e-4291-ae5b-f9f9bef7a99a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.735s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:18:33 user nova-compute[72178]: INFO nova.compute.claims [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Claim successful on node user
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:18:33 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.policy [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '517883471ec747278f78d0329efcccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2397edfe04144b7eaea8d06ceb971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:18:33 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Creating image(s)
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "/opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "/opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "/opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.019s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk 1073741824" returned: 0 in 0.049s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Successfully created port: 29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Cannot resize image /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'migration_context' on Instance uuid 508f4bcf-bc5b-44d5-85d6-ab6b90693afb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Ensure instance console log exists: /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "5f720460-477f-472a-904b-7a8c82bca76e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:34 user nova-compute[72178]: INFO nova.compute.manager [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Terminating instance
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-0636baa3-1ec2-4955-9deb-fb2669b6a865 req-7fd08735-5cba-48bc-be62-3452c0b01306 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received event network-vif-unplugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0636baa3-1ec2-4955-9deb-fb2669b6a865 req-7fd08735-5cba-48bc-be62-3452c0b01306 service nova] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0636baa3-1ec2-4955-9deb-fb2669b6a865 req-7fd08735-5cba-48bc-be62-3452c0b01306 service nova] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0636baa3-1ec2-4955-9deb-fb2669b6a865 req-7fd08735-5cba-48bc-be62-3452c0b01306 service nova] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-0636baa3-1ec2-4955-9deb-fb2669b6a865 req-7fd08735-5cba-48bc-be62-3452c0b01306 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] No waiting events found dispatching network-vif-unplugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:18:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-0636baa3-1ec2-4955-9deb-fb2669b6a865 req-7fd08735-5cba-48bc-be62-3452c0b01306 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received event network-vif-unplugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Successfully updated port: 29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquired lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-5d69d8e6-cb48-4739-9558-f81a0a384272 req-845bc04e-7410-482a-b8e9-ba3a4f9f5053 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received event network-changed-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-5d69d8e6-cb48-4739-9558-f81a0a384272 req-845bc04e-7410-482a-b8e9-ba3a4f9f5053 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Refreshing instance network info cache due to event network-changed-29c5428e-e0b4-4d19-825d-23eeb41dcec3. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5d69d8e6-cb48-4739-9558-f81a0a384272 req-845bc04e-7410-482a-b8e9-ba3a4f9f5053 service nova] Acquiring lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:18:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Instance destroyed successfully.
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lazy-loading 'resources' on Instance uuid 5f720460-477f-472a-904b-7a8c82bca76e {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T11:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-388288203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-388288203',id=6,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T11:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5e2fc3212d24561b0b971241fe367ec',ramdisk_id='',reservation_id='r-n34sr5b2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:00:51Z,user_data=None,user_id='ec0992e3a27a4a44922268a46b27ad83',uuid=5f720460-477f-472a-904b-7a8c82bca76e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converting VIF {"id": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "address": "fa:16:3e:bd:c9:7a", "network": {"id": "2b0189fa-e6b4-44d7-a16c-5056a7c2a91e", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-853326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5e2fc3212d24561b0b971241fe367ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39bff660-0a", "ovs_interfaceid": "39bff660-0a48-4f81-a38f-a10af4afd7f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=39bff660-0a48-4f81-a38f-a10af4afd7f8,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bff660-0a') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG os_vif [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=39bff660-0a48-4f81-a38f-a10af4afd7f8,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bff660-0a') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39bff660-0a, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:18:35 user nova-compute[72178]: INFO os_vif [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:c9:7a,bridge_name='br-int',has_traffic_filtering=True,id=39bff660-0a48-4f81-a38f-a10af4afd7f8,network=Network(2b0189fa-e6b4-44d7-a16c-5056a7c2a91e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39bff660-0a')
Aug 01 12:18:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Deleting instance files /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e_del
Aug 01 12:18:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Deletion of /opt/stack/data/nova/instances/5f720460-477f-472a-904b-7a8c82bca76e_del complete
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Updating instance_info_cache with network_info: [{"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Releasing lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Instance network_info: |[{"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5d69d8e6-cb48-4739-9558-f81a0a384272 req-845bc04e-7410-482a-b8e9-ba3a4f9f5053 service nova] Acquired lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.neutron [req-5d69d8e6-cb48-4739-9558-f81a0a384272 req-845bc04e-7410-482a-b8e9-ba3a4f9f5053 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Refreshing network info cache for port 29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Start _get_guest_xml network_info=[{"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:18:35 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:18:35 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-602252060',display_name='tempest-VolumesSnapshotTestJSON-instance-602252060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-602252060',id=41,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvVauUBtkzfDNXlimhMa04XBxSM1vi+2wj6M+u1pF/YMdOXzIYR6PXVEEPL/l1WE9K6cNewAMJANXI9wbLx9W8OJVY4vMRBm2cVRwUqy0UPn+gMYx/UtGPYJ3jjAsYaUg==',key_name='tempest-keypair-41142864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3e2397edfe04144b7eaea8d06ceb971',ramdisk_id='',reservation_id='r-0j2dojps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1949254885',owner_user_name='tempest-VolumesSnapshotTestJSON-1949254885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:18:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='517883471ec747278f78d0329efcccf6',uuid=508f4bcf-bc5b-44d5-85d6-ab6b90693afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converting VIF {"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d3:db,bridge_name='br-int',has_traffic_filtering=True,id=29c5428e-e0b4-4d19-825d-23eeb41dcec3,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c5428e-e0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'pci_devices' on Instance uuid 508f4bcf-bc5b-44d5-85d6-ab6b90693afb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:18:35 user nova-compute[72178]:   <uuid>508f4bcf-bc5b-44d5-85d6-ab6b90693afb</uuid>
Aug 01 12:18:35 user nova-compute[72178]:   <name>instance-00000029</name>
Aug 01 12:18:35 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:18:35 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:18:35 user nova-compute[72178]:   <metadata>
Aug 01 12:18:35 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:18:35 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:18:35 user nova-compute[72178]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-602252060</nova:name>
Aug 01 12:18:35 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:18:35</nova:creationTime>
Aug 01 12:18:35 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:18:35 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:18:35 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:18:35 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:18:35 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:18:35 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:18:35 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:18:35 user nova-compute[72178]:       <nova:owner>
Aug 01 12:18:35 user nova-compute[72178]:         <nova:user uuid="517883471ec747278f78d0329efcccf6">tempest-VolumesSnapshotTestJSON-1949254885-project-member</nova:user>
Aug 01 12:18:35 user nova-compute[72178]:         <nova:project uuid="c3e2397edfe04144b7eaea8d06ceb971">tempest-VolumesSnapshotTestJSON-1949254885</nova:project>
Aug 01 12:18:35 user nova-compute[72178]:       </nova:owner>
Aug 01 12:18:35 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:18:35 user nova-compute[72178]:       <nova:ports>
Aug 01 12:18:35 user nova-compute[72178]:         <nova:port uuid="29c5428e-e0b4-4d19-825d-23eeb41dcec3">
Aug 01 12:18:35 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 01 12:18:35 user nova-compute[72178]:         </nova:port>
Aug 01 12:18:35 user nova-compute[72178]:       </nova:ports>
Aug 01 12:18:35 user nova-compute[72178]:     </nova:instance>
Aug 01 12:18:35 user nova-compute[72178]:   </metadata>
Aug 01 12:18:35 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:18:35 user nova-compute[72178]:     <system>
Aug 01 12:18:35 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:18:35 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:18:35 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:18:35 user nova-compute[72178]:       <entry name="serial">508f4bcf-bc5b-44d5-85d6-ab6b90693afb</entry>
Aug 01 12:18:35 user nova-compute[72178]:       <entry name="uuid">508f4bcf-bc5b-44d5-85d6-ab6b90693afb</entry>
Aug 01 12:18:35 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:18:35 user nova-compute[72178]:     </system>
Aug 01 12:18:35 user nova-compute[72178]:   </sysinfo>
Aug 01 12:18:35 user nova-compute[72178]:   <os>
Aug 01 12:18:35 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:18:35 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:18:35 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:18:35 user nova-compute[72178]:   </os>
Aug 01 12:18:35 user nova-compute[72178]:   <features>
Aug 01 12:18:35 user nova-compute[72178]:     <acpi/>
Aug 01 12:18:35 user nova-compute[72178]:     <apic/>
Aug 01 12:18:35 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:18:35 user nova-compute[72178]:   </features>
Aug 01 12:18:35 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:18:35 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:18:35 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:18:35 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:18:35 user nova-compute[72178]:   </clock>
Aug 01 12:18:35 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:18:35 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:18:35 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:18:35 user nova-compute[72178]:   </cpu>
Aug 01 12:18:35 user nova-compute[72178]:   <devices>
Aug 01 12:18:35 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:18:35 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:18:35 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk"/>
Aug 01 12:18:35 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:18:35 user nova-compute[72178]:     </disk>
Aug 01 12:18:35 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:18:35 user nova-compute[72178]:       <mac address="fa:16:3e:6c:d3:db"/>
Aug 01 12:18:35 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:18:35 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:18:35 user nova-compute[72178]:       <target dev="tap29c5428e-e0"/>
Aug 01 12:18:35 user nova-compute[72178]:     </interface>
Aug 01 12:18:35 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:18:35 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/console.log" append="off"/>
Aug 01 12:18:35 user nova-compute[72178]:     </serial>
Aug 01 12:18:35 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:18:35 user nova-compute[72178]:     <video>
Aug 01 12:18:35 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:18:35 user nova-compute[72178]:     </video>
Aug 01 12:18:35 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:18:35 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:18:35 user nova-compute[72178]:     </rng>
Aug 01 12:18:35 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:18:35 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:18:35 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:18:35 user nova-compute[72178]:     </memballoon>
Aug 01 12:18:35 user nova-compute[72178]:   </devices>
Aug 01 12:18:35 user nova-compute[72178]: </domain>
Aug 01 12:18:35 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-602252060',display_name='tempest-VolumesSnapshotTestJSON-instance-602252060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-602252060',id=41,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvVauUBtkzfDNXlimhMa04XBxSM1vi+2wj6M+u1pF/YMdOXzIYR6PXVEEPL/l1WE9K6cNewAMJANXI9wbLx9W8OJVY4vMRBm2cVRwUqy0UPn+gMYx/UtGPYJ3jjAsYaUg==',key_name='tempest-keypair-41142864',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3e2397edfe04144b7eaea8d06ceb971',ramdisk_id='',reservation_id='r-0j2dojps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1949254885',owner_user_name='tempest-VolumesSnapshotTestJSON-1949254885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:18:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='517883471ec747278f78d0329efcccf6',uuid=508f4bcf-bc5b-44d5-85d6-ab6b90693afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converting VIF {"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d3:db,bridge_name='br-int',has_traffic_filtering=True,id=29c5428e-e0b4-4d19-825d-23eeb41dcec3,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c5428e-e0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG os_vif [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d3:db,bridge_name='br-int',has_traffic_filtering=True,id=29c5428e-e0b4-4d19-825d-23eeb41dcec3,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c5428e-e0') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29c5428e-e0, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29c5428e-e0, col_values=(('external_ids', {'iface-id': '29c5428e-e0b4-4d19-825d-23eeb41dcec3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:d3:db', 'vm-uuid': '508f4bcf-bc5b-44d5-85d6-ab6b90693afb'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:18:35 user nova-compute[72178]: INFO nova.compute.manager [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 01 12:18:35 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:35 user nova-compute[72178]: INFO os_vif [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:d3:db,bridge_name='br-int',has_traffic_filtering=True,id=29c5428e-e0b4-4d19-825d-23eeb41dcec3,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c5428e-e0')
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:18:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No VIF found with MAC fa:16:3e:6c:d3:db, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:18:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-5d69d8e6-cb48-4739-9558-f81a0a384272 req-845bc04e-7410-482a-b8e9-ba3a4f9f5053 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Updated VIF entry in instance network info cache for port 29c5428e-e0b4-4d19-825d-23eeb41dcec3. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:18:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-5d69d8e6-cb48-4739-9558-f81a0a384272 req-845bc04e-7410-482a-b8e9-ba3a4f9f5053 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Updating instance_info_cache with network_info: [{"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:18:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5d69d8e6-cb48-4739-9558-f81a0a384272 req-845bc04e-7410-482a-b8e9-ba3a4f9f5053 service nova] Releasing lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:18:36 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:18:36 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Took 0.73 seconds to deallocate network for instance.
Aug 01 12:18:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:36 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:18:36 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:18:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:36 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Deleted allocations for instance 5f720460-477f-472a-904b-7a8c82bca76e
Aug 01 12:18:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e3368867-4f96-4976-a645-532696dc0665 tempest-ServerBootFromVolumeStableRescueTest-2013636577 tempest-ServerBootFromVolumeStableRescueTest-2013636577-project-member] Lock "5f720460-477f-472a-904b-7a8c82bca76e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.343s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-7ccbd3b1-a160-4cb7-b13c-355b276c87e0 req-33b08f33-738f-44ed-9911-07f3070583d2 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received event network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7ccbd3b1-a160-4cb7-b13c-355b276c87e0 req-33b08f33-738f-44ed-9911-07f3070583d2 service nova] Acquiring lock "5f720460-477f-472a-904b-7a8c82bca76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7ccbd3b1-a160-4cb7-b13c-355b276c87e0 req-33b08f33-738f-44ed-9911-07f3070583d2 service nova] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7ccbd3b1-a160-4cb7-b13c-355b276c87e0 req-33b08f33-738f-44ed-9911-07f3070583d2 service nova] Lock "5f720460-477f-472a-904b-7a8c82bca76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-7ccbd3b1-a160-4cb7-b13c-355b276c87e0 req-33b08f33-738f-44ed-9911-07f3070583d2 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] No waiting events found dispatching network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:18:37 user nova-compute[72178]: WARNING nova.compute.manager [req-7ccbd3b1-a160-4cb7-b13c-355b276c87e0 req-33b08f33-738f-44ed-9911-07f3070583d2 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received unexpected event network-vif-plugged-39bff660-0a48-4f81-a38f-a10af4afd7f8 for instance with vm_state deleted and task_state None.
Aug 01 12:18:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-9a2af96c-16dc-4a0d-b617-5fa78e2aed48 req-2fb5daf8-f356-43e4-bdd4-eb0a38f22a96 service nova] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Received event network-vif-deleted-39bff660-0a48-4f81-a38f-a10af4afd7f8 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-9480daa5-8b99-44f4-943c-9a36d94c7502 req-16c77aaa-3ce0-4255-beff-8f267d5e182a service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received event network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9480daa5-8b99-44f4-943c-9a36d94c7502 req-16c77aaa-3ce0-4255-beff-8f267d5e182a service nova] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9480daa5-8b99-44f4-943c-9a36d94c7502 req-16c77aaa-3ce0-4255-beff-8f267d5e182a service nova] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9480daa5-8b99-44f4-943c-9a36d94c7502 req-16c77aaa-3ce0-4255-beff-8f267d5e182a service nova] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-9480daa5-8b99-44f4-943c-9a36d94c7502 req-16c77aaa-3ce0-4255-beff-8f267d5e182a service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] No waiting events found dispatching network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:18:37 user nova-compute[72178]: WARNING nova.compute.manager [req-9480daa5-8b99-44f4-943c-9a36d94c7502 req-16c77aaa-3ce0-4255-beff-8f267d5e182a service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received unexpected event network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 for instance with vm_state building and task_state spawning.
Aug 01 12:18:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892319.2883577, 508f4bcf-bc5b-44d5-85d6-ab6b90693afb => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:18:39 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] VM Resumed (Lifecycle Event)
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:18:39 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Instance spawned successfully.
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-b5472772-3232-49ec-bffa-ecc0fa9851cf req-4af8a361-f803-46b0-91b1-638cc378cced service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received event network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b5472772-3232-49ec-bffa-ecc0fa9851cf req-4af8a361-f803-46b0-91b1-638cc378cced service nova] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b5472772-3232-49ec-bffa-ecc0fa9851cf req-4af8a361-f803-46b0-91b1-638cc378cced service nova] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b5472772-3232-49ec-bffa-ecc0fa9851cf req-4af8a361-f803-46b0-91b1-638cc378cced service nova] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-b5472772-3232-49ec-bffa-ecc0fa9851cf req-4af8a361-f803-46b0-91b1-638cc378cced service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] No waiting events found dispatching network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:18:39 user nova-compute[72178]: WARNING nova.compute.manager [req-b5472772-3232-49ec-bffa-ecc0fa9851cf req-4af8a361-f803-46b0-91b1-638cc378cced service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received unexpected event network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 for instance with vm_state building and task_state spawning.
Aug 01 12:18:39 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892319.2925124, 508f4bcf-bc5b-44d5-85d6-ab6b90693afb => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:18:39 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] VM Started (Lifecycle Event)
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:18:39 user nova-compute[72178]: INFO nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Took 5.71 seconds to spawn the instance on the hypervisor.
Aug 01 12:18:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:18:39 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:18:39 user nova-compute[72178]: INFO nova.compute.manager [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Took 6.29 seconds to build instance.
Aug 01 12:18:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bfe567d1-55b7-4450-ac99-6102f5e6bdfb tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.406s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-c052cbba-f61e-4bd2-ae23-1d6e9a3909f8 req-199e15d6-01c7-4125-bea0-0c08425774ce service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received event network-changed-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG nova.compute.manager [req-c052cbba-f61e-4bd2-ae23-1d6e9a3909f8 req-199e15d6-01c7-4125-bea0-0c08425774ce service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Refreshing instance network info cache due to event network-changed-06f5474e-80b3-4c75-b7c5-3033ce9141c2. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c052cbba-f61e-4bd2-ae23-1d6e9a3909f8 req-199e15d6-01c7-4125-bea0-0c08425774ce service nova] Acquiring lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c052cbba-f61e-4bd2-ae23-1d6e9a3909f8 req-199e15d6-01c7-4125-bea0-0c08425774ce service nova] Acquired lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG nova.network.neutron [req-c052cbba-f61e-4bd2-ae23-1d6e9a3909f8 req-199e15d6-01c7-4125-bea0-0c08425774ce service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Refreshing network info cache for port 06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:18:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7876MB free_disk=25.304786682128906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:48 user nova-compute[72178]: INFO nova.compute.manager [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Terminating instance
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-c052cbba-f61e-4bd2-ae23-1d6e9a3909f8 req-199e15d6-01c7-4125-bea0-0c08425774ce service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Updated VIF entry in instance network info cache for port 06f5474e-80b3-4c75-b7c5-3033ce9141c2. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-c052cbba-f61e-4bd2-ae23-1d6e9a3909f8 req-199e15d6-01c7-4125-bea0-0c08425774ce service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Updating instance_info_cache with network_info: [{"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c052cbba-f61e-4bd2-ae23-1d6e9a3909f8 req-199e15d6-01c7-4125-bea0-0c08425774ce service nova] Releasing lock "refresh_cache-f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f83a6749-76c7-4af7-b72d-9bc3d4d4cab9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5b81c686-411a-4d3a-86da-4089747b1441 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-47921581-0d71-41dc-ad97-70a67de6b785 req-886c18db-98fe-446c-af06-6a37879c98f2 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received event network-vif-unplugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-47921581-0d71-41dc-ad97-70a67de6b785 req-886c18db-98fe-446c-af06-6a37879c98f2 service nova] Acquiring lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-47921581-0d71-41dc-ad97-70a67de6b785 req-886c18db-98fe-446c-af06-6a37879c98f2 service nova] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-47921581-0d71-41dc-ad97-70a67de6b785 req-886c18db-98fe-446c-af06-6a37879c98f2 service nova] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-47921581-0d71-41dc-ad97-70a67de6b785 req-886c18db-98fe-446c-af06-6a37879c98f2 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] No waiting events found dispatching network-vif-unplugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-47921581-0d71-41dc-ad97-70a67de6b785 req-886c18db-98fe-446c-af06-6a37879c98f2 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received event network-vif-unplugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:18:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.401s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Instance destroyed successfully.
Aug 01 12:18:49 user nova-compute[72178]: DEBUG nova.objects.instance [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'resources' on Instance uuid f83a6749-76c7-4af7-b72d-9bc3d4d4cab9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:16:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1114288860',display_name='tempest-TestVolumeBootPattern-server-1114288860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1114288860',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:17:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-gfwwc447',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:17:09Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=f83a6749-76c7-4af7-b72d-9bc3d4d4cab9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "address": "fa:16:3e:9d:20:11", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06f5474e-80", "ovs_interfaceid": "06f5474e-80b3-4c75-b7c5-3033ce9141c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:20:11,bridge_name='br-int',has_traffic_filtering=True,id=06f5474e-80b3-4c75-b7c5-3033ce9141c2,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f5474e-80') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_vif [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:20:11,bridge_name='br-int',has_traffic_filtering=True,id=06f5474e-80b3-4c75-b7c5-3033ce9141c2,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f5474e-80') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06f5474e-80, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:18:49 user nova-compute[72178]: INFO os_vif [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:20:11,bridge_name='br-int',has_traffic_filtering=True,id=06f5474e-80b3-4c75-b7c5-3033ce9141c2,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06f5474e-80')
Aug 01 12:18:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDeisuSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:18:49 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[015873a2-5081-4928-b12f-5f9a940db2b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b7ea8c-4f1b-4c68-928c-e62f692bf8fb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:18:49 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:18:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:18:49 user nova-compute[72178]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:18:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f4757250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2dc5a8-23b5-4030-a200-69f02a0a2bb4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0554ff-8ea0-40b2-adc1-8e0eec88197f]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bebd730-92b7-4e6b-b52c-ccf685fe8bbf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6565a2-b3c8-4cee-ae0d-e97e45a0a210]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e8416fdc', '/dev/disk/by-id/scsi-1SCST_BIOe8416fdc-b50ac2a5c85ea1c3', '/dev/disk/by-id/scsi-26235306163326135') {{(pid=83857) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9219375d-6ab6-444d-a935-ec08eeaf3061]: (4, None) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f367064-762c-431f-8b11-e6802c847614]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[798635ce-cb8d-41d0-8252-2940a3213a18]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260]
Aug 01 12:18:49 user nova-compute[72178]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260] successful.
Aug 01 12:18:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bd7a7e-c72f-42c9-9554-2eebaf1d2781]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== disconnect_volume: return (362ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:18:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:18:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Deleting instance files /opt/stack/data/nova/instances/f83a6749-76c7-4af7-b72d-9bc3d4d4cab9_del
Aug 01 12:18:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Deletion of /opt/stack/data/nova/instances/f83a6749-76c7-4af7-b72d-9bc3d4d4cab9_del complete
Aug 01 12:18:50 user nova-compute[72178]: INFO nova.compute.manager [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Took 1.53 seconds to destroy the instance on the hypervisor.
Aug 01 12:18:50 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:18:50 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:18:50 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:18:50 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892315.3760004, 5f720460-477f-472a-904b-7a8c82bca76e => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:18:50 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] VM Stopped (Lifecycle Event)
Aug 01 12:18:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-f73fdf3b-2f75-4a7f-bbab-0d0d9a350f65 None None] [instance: 5f720460-477f-472a-904b-7a8c82bca76e] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:18:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-8168e185-3333-44cb-a51c-ae767af8e3d9 req-36bc8108-2d49-4378-9c6d-726c33bfe3e3 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received event network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8168e185-3333-44cb-a51c-ae767af8e3d9 req-36bc8108-2d49-4378-9c6d-726c33bfe3e3 service nova] Acquiring lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8168e185-3333-44cb-a51c-ae767af8e3d9 req-36bc8108-2d49-4378-9c6d-726c33bfe3e3 service nova] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8168e185-3333-44cb-a51c-ae767af8e3d9 req-36bc8108-2d49-4378-9c6d-726c33bfe3e3 service nova] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-8168e185-3333-44cb-a51c-ae767af8e3d9 req-36bc8108-2d49-4378-9c6d-726c33bfe3e3 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] No waiting events found dispatching network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:18:50 user nova-compute[72178]: WARNING nova.compute.manager [req-8168e185-3333-44cb-a51c-ae767af8e3d9 req-36bc8108-2d49-4378-9c6d-726c33bfe3e3 service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received unexpected event network-vif-plugged-06f5474e-80b3-4c75-b7c5-3033ce9141c2 for instance with vm_state active and task_state deleting.
Aug 01 12:18:51 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:18:51 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Took 1.03 seconds to deallocate network for instance.
Aug 01 12:18:51 user nova-compute[72178]: INFO nova.compute.manager [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Took 0.81 seconds to detach 1 volumes for instance.
Aug 01 12:18:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:18:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:18:52 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:18:52 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:18:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:52 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Deleted allocations for instance f83a6749-76c7-4af7-b72d-9bc3d4d4cab9
Aug 01 12:18:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ca853e43-b98d-47f0-926b-76cac4ee92b2 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "f83a6749-76c7-4af7-b72d-9bc3d4d4cab9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.787s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:18:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-92219200-9a8b-4f7a-a9ef-3499ef2f8aba req-026cf7a1-9e89-40e3-8b03-bc201a8ba4bd service nova] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Received event network-vif-deleted-06f5474e-80b3-4c75-b7c5-3033ce9141c2 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:18:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:57 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:18:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:04 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892329.3184826, f83a6749-76c7-4af7-b72d-9bc3d4d4cab9 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:19:04 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] VM Stopped (Lifecycle Event)
Aug 01 12:19:04 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c40ebd1c-9107-4b1b-8eca-7b23eab62cfe None None] [instance: f83a6749-76c7-4af7-b72d-9bc3d4d4cab9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:08 user nova-compute[72178]: INFO nova.compute.manager [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Detaching volume 99579ea8-a988-4a66-bd52-c38d5d003d34
Aug 01 12:19:08 user nova-compute[72178]: INFO nova.virt.block_device [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Attempting to driver detach volume 99579ea8-a988-4a66-bd52-c38d5d003d34 from mountpoint /dev/vdb
Aug 01 12:19:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Attempting to detach device vdb from instance 6c816328-61df-4625-95e6-bc27fbd7148d from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:19:08 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:19:08 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:19:08 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:19:08 user nova-compute[72178]:   <serial>99579ea8-a988-4a66-bd52-c38d5d003d34</serial>
Aug 01 12:19:08 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 12:19:08 user nova-compute[72178]: </disk>
Aug 01 12:19:08 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:19:08 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully detached device vdb from instance 6c816328-61df-4625-95e6-bc27fbd7148d from the persistent domain config.
Aug 01 12:19:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c816328-61df-4625-95e6-bc27fbd7148d from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:19:08 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:19:08 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:19:08 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:19:08 user nova-compute[72178]:   <serial>99579ea8-a988-4a66-bd52-c38d5d003d34</serial>
Aug 01 12:19:08 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 01 12:19:08 user nova-compute[72178]: </disk>
Aug 01 12:19:08 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892348.963164, 6c816328-61df-4625-95e6-bc27fbd7148d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:19:08 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully detached device vdb from instance 6c816328-61df-4625-95e6-bc27fbd7148d from the live domain config.
Aug 01 12:19:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwUSojVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:19:08 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:19:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5f826-a039-496e-9271-be0533839a0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[220dbc55-2940-4dd8-b8cc-fe52e8e88b82]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:19:09 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 (non-flash)
Aug 01 12:19:09 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f4364790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc67b50-ecf8-4b3b-ba4b-fbc82a22c1bd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f9328-ea03-44d6-943d-4bba5eddc40b]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[709b28e7-1409-4a31-bc48-605c38187043]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cfde86-1c07-4ae7-bc52-2ef8aeb283d5]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5af6d4d-023f-4210-99c0-5de9004d93ff]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f77065-7249-40a2-bec6-0464f0f72adc]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260]
Aug 01 12:19:09 user nova-compute[72178]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34, portal: 172.16.0.220,3260] successful.
Aug 01 12:19:09 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99579ea8-a988-4a66-bd52-c38d5d003d34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab8615b-ff10-4a44-a66b-fc01cb46c7f7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== disconnect_volume: return (268ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:19:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e95df5a0-894c-4d93-9b27-0b56a4ac6a31 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.776s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6f282e67-b5c2-42c2-95d4-4adaaa104892 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6f282e67-b5c2-42c2-95d4-4adaaa104892 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6f282e67-b5c2-42c2-95d4-4adaaa104892 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6f282e67-b5c2-42c2-95d4-4adaaa104892 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72178) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6f282e67-b5c2-42c2-95d4-4adaaa104892 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-a3e04bb3-8047-47d0-8cc9-3b60c5983c3b req-9bd53ba5-41d0-4334-a86f-fc91b657ee13 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3e04bb3-8047-47d0-8cc9-3b60c5983c3b req-9bd53ba5-41d0-4334-a86f-fc91b657ee13 service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3e04bb3-8047-47d0-8cc9-3b60c5983c3b req-9bd53ba5-41d0-4334-a86f-fc91b657ee13 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a3e04bb3-8047-47d0-8cc9-3b60c5983c3b req-9bd53ba5-41d0-4334-a86f-fc91b657ee13 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-a3e04bb3-8047-47d0-8cc9-3b60c5983c3b req-9bd53ba5-41d0-4334-a86f-fc91b657ee13 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:19:11 user nova-compute[72178]: WARNING nova.compute.manager [req-a3e04bb3-8047-47d0-8cc9-3b60c5983c3b req-9bd53ba5-41d0-4334-a86f-fc91b657ee13 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state active and task_state powering-off.
Aug 01 12:19:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance destroyed successfully.
Aug 01 12:19:11 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6f282e67-b5c2-42c2-95d4-4adaaa104892 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6f282e67-b5c2-42c2-95d4-4adaaa104892 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.855s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-296e5303-0b47-418b-969b-c674587a242d req-34dff05f-3fd8-46d2-8041-cb9e081183a5 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-296e5303-0b47-418b-969b-c674587a242d req-34dff05f-3fd8-46d2-8041-cb9e081183a5 service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-296e5303-0b47-418b-969b-c674587a242d req-34dff05f-3fd8-46d2-8041-cb9e081183a5 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-296e5303-0b47-418b-969b-c674587a242d req-34dff05f-3fd8-46d2-8041-cb9e081183a5 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-296e5303-0b47-418b-969b-c674587a242d req-34dff05f-3fd8-46d2-8041-cb9e081183a5 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:19:13 user nova-compute[72178]: WARNING nova.compute.manager [req-296e5303-0b47-418b-969b-c674587a242d req-34dff05f-3fd8-46d2-8041-cb9e081183a5 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state stopped and task_state None.
Aug 01 12:19:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:15 user nova-compute[72178]: INFO nova.compute.manager [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] instance snapshotting
Aug 01 12:19:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Beginning live snapshot process
Aug 01 12:19:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json -f qcow2 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json -f qcow2 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json -f qcow2" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj39cr46r/09841863baa041bbb15b058321488caf.delta 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj39cr46r/09841863baa041bbb15b058321488caf.delta 1073741824" returned: 0 in 0.050s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 01 12:19:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:19:17 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] COPY block job progress, current cursor: 26411008 final cursor: 75563008 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:19:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72178) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 01 12:19:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 01 12:19:18 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:19:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj39cr46r/09841863baa041bbb15b058321488caf.delta /opt/stack/data/nova/instances/snapshots/tmpj39cr46r/09841863baa041bbb15b058321488caf {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:18 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj39cr46r/09841863baa041bbb15b058321488caf.delta /opt/stack/data/nova/instances/snapshots/tmpj39cr46r/09841863baa041bbb15b058321488caf" returned: 0 in 0.447s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Snapshot extracted, beginning image upload
Aug 01 12:19:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-237d4fcb-fe8a-4009-8228-2107f4ca1e8b req-b74de4d6-7439-44bd-94ae-272ee70f906d service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received event network-changed-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-237d4fcb-fe8a-4009-8228-2107f4ca1e8b req-b74de4d6-7439-44bd-94ae-272ee70f906d service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Refreshing instance network info cache due to event network-changed-554ca614-c20e-47aa-a828-c58f9c155992. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:19:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-237d4fcb-fe8a-4009-8228-2107f4ca1e8b req-b74de4d6-7439-44bd-94ae-272ee70f906d service nova] Acquiring lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:19:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-237d4fcb-fe8a-4009-8228-2107f4ca1e8b req-b74de4d6-7439-44bd-94ae-272ee70f906d service nova] Acquired lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:19:20 user nova-compute[72178]: DEBUG nova.network.neutron [req-237d4fcb-fe8a-4009-8228-2107f4ca1e8b req-b74de4d6-7439-44bd-94ae-272ee70f906d service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Refreshing network info cache for port 554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:19:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Snapshot image upload complete
Aug 01 12:19:21 user nova-compute[72178]: INFO nova.compute.manager [None req-74ea7371-cb78-4c44-ab98-b7230db2459a tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Took 5.49 seconds to snapshot the instance on the hypervisor.
Aug 01 12:19:21 user nova-compute[72178]: DEBUG nova.network.neutron [req-237d4fcb-fe8a-4009-8228-2107f4ca1e8b req-b74de4d6-7439-44bd-94ae-272ee70f906d service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Updated VIF entry in instance network info cache for port 554ca614-c20e-47aa-a828-c58f9c155992. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:19:21 user nova-compute[72178]: DEBUG nova.network.neutron [req-237d4fcb-fe8a-4009-8228-2107f4ca1e8b req-b74de4d6-7439-44bd-94ae-272ee70f906d service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Updating instance_info_cache with network_info: [{"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:19:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-237d4fcb-fe8a-4009-8228-2107f4ca1e8b req-b74de4d6-7439-44bd-94ae-272ee70f906d service nova] Releasing lock "refresh_cache-5b81c686-411a-4d3a-86da-4089747b1441" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:19:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:19:24 user nova-compute[72178]: INFO nova.compute.claims [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Claim successful on node user
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.network.neutron [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:19:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.policy [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fae1f92a5fa44879a3a523589e12a5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af152857bb640f591e8f0a09ff89837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid 5b81c686-411a-4d3a-86da-4089747b1441 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:19:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Creating image(s)
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "/opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "/opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "/opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "9d432c4b576e83093fb5f73ed4476c688d4bd30f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "9d432c4b576e83093fb5f73ed4476c688d4bd30f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f.part --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG nova.network.neutron [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Successfully created port: 7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:25 user nova-compute[72178]: INFO nova.compute.manager [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Attaching volume 7f758af5-b626-4e09-96ca-9a6914cc99b8 to /dev/vdb
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f.part --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG nova.virt.images [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] 6bc8e4c4-2030-4644-8569-da91fde6f987 was qcow2, converting to raw {{(pid=72178) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG nova.privsep.utils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72178) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f.part /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f.converted {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG os_brick.utils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[255e536c-c4f0-4a9c-bd2f-6ac775a0412b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.047s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b14708-6b79-49ec-b356-15938eff83eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2919086-697e-42ce-8e0f-bae8660a8459]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4e86d1-b39f-4fcd-a4d2-38da662522fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:19:25 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:19:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d2cf1c-e0ec-4d70-b9e2-30ac157136ed]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG os_brick.utils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:19:25 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Updating existing volume attachment record: d9d04f85-c029-43da-a9ca-8f941bd49a5e {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892351.502136, 6c816328-61df-4625-95e6-bc27fbd7148d => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:19:26 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Stopped (Lifecycle Event)
Aug 01 12:19:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e01b3a92-ba88-4e3b-baf8-c2e6896dcc7e None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e01b3a92-ba88-4e3b-baf8-c2e6896dcc7e None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f.part /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f.converted" returned: 0 in 0.923s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f.converted --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "9d432c4b576e83093fb5f73ed4476c688d4bd30f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.145s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG nova.network.neutron [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Successfully updated port: 7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquired lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG nova.network.neutron [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "9d432c4b576e83093fb5f73ed4476c688d4bd30f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "9d432c4b576e83093fb5f73ed4476c688d4bd30f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:26 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-f587c2cb-6087-46ca-8794-5806c42b74d6 req-623536b3-879f-4b7a-bf17-1ee27005f523 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received event network-changed-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-f587c2cb-6087-46ca-8794-5806c42b74d6 req-623536b3-879f-4b7a-bf17-1ee27005f523 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Refreshing instance network info cache due to event network-changed-7eacccce-d3b6-4750-9a19-2852f48b57e3. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f587c2cb-6087-46ca-8794-5806c42b74d6 req-623536b3-879f-4b7a-bf17-1ee27005f523 service nova] Acquiring lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f,backing_fmt=raw /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f,backing_fmt=raw /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk 1073741824" returned: 0 in 0.060s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "9d432c4b576e83093fb5f73ed4476c688d4bd30f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.objects.instance [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'migration_context' on Instance uuid 53f00180-560e-486e-92a9-558bed951f36 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Ensure instance console log exists: /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.neutron [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updating instance_info_cache with network_info: [{"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Releasing lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Instance network_info: |[{"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f587c2cb-6087-46ca-8794-5806c42b74d6 req-623536b3-879f-4b7a-bf17-1ee27005f523 service nova] Acquired lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.neutron [req-f587c2cb-6087-46ca-8794-5806c42b74d6 req-623536b3-879f-4b7a-bf17-1ee27005f523 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Refreshing network info cache for port 7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Start _get_guest_xml network_info=[{"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='867a792ae1e810ebdc50aaa486025db7',container_format='bare',created_at=2023-08-01T12:19:16Z,direct_url=<?>,disk_format='qcow2',id=6bc8e4c4-2030-4644-8569-da91fde6f987,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1231713309',owner='0af152857bb640f591e8f0a09ff89837',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T12:19:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': '6bc8e4c4-2030-4644-8569-da91fde6f987'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:19:27 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:19:27 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='867a792ae1e810ebdc50aaa486025db7',container_format='bare',created_at=2023-08-01T12:19:16Z,direct_url=<?>,disk_format='qcow2',id=6bc8e4c4-2030-4644-8569-da91fde6f987,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1231713309',owner='0af152857bb640f591e8f0a09ff89837',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-01T12:19:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1382486598',display_name='tempest-TestStampPattern-server-1382486598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1382486598',id=42,image_ref='6bc8e4c4-2030-4644-8569-da91fde6f987',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY0D3vdAXP1Uw5iOPQrUFMzzsglvj6jvcAFaLJfftLI5qdjFbF3qmMqlBS6g6gXV6f3NDdy+mfkiStVBeHEEmPFhi29WKhEbf8vOEiEeuKxD5jDUbAuPzUzAbvJ63afJA==',key_name='tempest-TestStampPattern-274602689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af152857bb640f591e8f0a09ff89837',ramdisk_id='',reservation_id='r-vpczjglr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f0ef243f-6c58-4991-97b1-0883d24dd6c9',image_min_disk='1',image_min_ram='0',image_owner_id='0af152857bb640f591e8f0a09ff89837',image_owner_project_name='tempest-TestStampPattern-1531717549',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1531717549-project-member',image_user_id='fae1f92a5fa44879a3a523589e12a5ef',network_allocated='True',owner_project_name='tempest-TestStampPattern-1531717549',owner_user_name='tempest-TestStampPattern-1531717549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:19:25Z,user_data=None,user_id='fae1f92a5fa44879a3a523589e12a5ef',uuid=53f00180-560e-486e-92a9-558bed951f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converting VIF {"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=7eacccce-d3b6-4750-9a19-2852f48b57e3,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eacccce-d3') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.objects.instance [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'pci_devices' on Instance uuid 53f00180-560e-486e-92a9-558bed951f36 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:19:27 user nova-compute[72178]:   <uuid>53f00180-560e-486e-92a9-558bed951f36</uuid>
Aug 01 12:19:27 user nova-compute[72178]:   <name>instance-0000002a</name>
Aug 01 12:19:27 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:19:27 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:19:27 user nova-compute[72178]:   <metadata>
Aug 01 12:19:27 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:19:27 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:19:27 user nova-compute[72178]:       <nova:name>tempest-TestStampPattern-server-1382486598</nova:name>
Aug 01 12:19:27 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:19:27</nova:creationTime>
Aug 01 12:19:27 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:19:27 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:19:27 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:19:27 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:19:27 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:19:27 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:19:27 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:19:27 user nova-compute[72178]:       <nova:owner>
Aug 01 12:19:27 user nova-compute[72178]:         <nova:user uuid="fae1f92a5fa44879a3a523589e12a5ef">tempest-TestStampPattern-1531717549-project-member</nova:user>
Aug 01 12:19:27 user nova-compute[72178]:         <nova:project uuid="0af152857bb640f591e8f0a09ff89837">tempest-TestStampPattern-1531717549</nova:project>
Aug 01 12:19:27 user nova-compute[72178]:       </nova:owner>
Aug 01 12:19:27 user nova-compute[72178]:       <nova:root type="image" uuid="6bc8e4c4-2030-4644-8569-da91fde6f987"/>
Aug 01 12:19:27 user nova-compute[72178]:       <nova:ports>
Aug 01 12:19:27 user nova-compute[72178]:         <nova:port uuid="7eacccce-d3b6-4750-9a19-2852f48b57e3">
Aug 01 12:19:27 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 01 12:19:27 user nova-compute[72178]:         </nova:port>
Aug 01 12:19:27 user nova-compute[72178]:       </nova:ports>
Aug 01 12:19:27 user nova-compute[72178]:     </nova:instance>
Aug 01 12:19:27 user nova-compute[72178]:   </metadata>
Aug 01 12:19:27 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:19:27 user nova-compute[72178]:     <system>
Aug 01 12:19:27 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:19:27 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:19:27 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:19:27 user nova-compute[72178]:       <entry name="serial">53f00180-560e-486e-92a9-558bed951f36</entry>
Aug 01 12:19:27 user nova-compute[72178]:       <entry name="uuid">53f00180-560e-486e-92a9-558bed951f36</entry>
Aug 01 12:19:27 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:19:27 user nova-compute[72178]:     </system>
Aug 01 12:19:27 user nova-compute[72178]:   </sysinfo>
Aug 01 12:19:27 user nova-compute[72178]:   <os>
Aug 01 12:19:27 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:19:27 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:19:27 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:19:27 user nova-compute[72178]:   </os>
Aug 01 12:19:27 user nova-compute[72178]:   <features>
Aug 01 12:19:27 user nova-compute[72178]:     <acpi/>
Aug 01 12:19:27 user nova-compute[72178]:     <apic/>
Aug 01 12:19:27 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:19:27 user nova-compute[72178]:   </features>
Aug 01 12:19:27 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:19:27 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:19:27 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:19:27 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:19:27 user nova-compute[72178]:   </clock>
Aug 01 12:19:27 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:19:27 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:19:27 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:19:27 user nova-compute[72178]:   </cpu>
Aug 01 12:19:27 user nova-compute[72178]:   <devices>
Aug 01 12:19:27 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:19:27 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:19:27 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk"/>
Aug 01 12:19:27 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:19:27 user nova-compute[72178]:     </disk>
Aug 01 12:19:27 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:19:27 user nova-compute[72178]:       <mac address="fa:16:3e:ce:f6:dd"/>
Aug 01 12:19:27 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:19:27 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:19:27 user nova-compute[72178]:       <target dev="tap7eacccce-d3"/>
Aug 01 12:19:27 user nova-compute[72178]:     </interface>
Aug 01 12:19:27 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:19:27 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/console.log" append="off"/>
Aug 01 12:19:27 user nova-compute[72178]:     </serial>
Aug 01 12:19:27 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:19:27 user nova-compute[72178]:     <video>
Aug 01 12:19:27 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:19:27 user nova-compute[72178]:     </video>
Aug 01 12:19:27 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:19:27 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:19:27 user nova-compute[72178]:     </rng>
Aug 01 12:19:27 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:19:27 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:19:27 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:19:27 user nova-compute[72178]:     </memballoon>
Aug 01 12:19:27 user nova-compute[72178]:   </devices>
Aug 01 12:19:27 user nova-compute[72178]: </domain>
Aug 01 12:19:27 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1382486598',display_name='tempest-TestStampPattern-server-1382486598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1382486598',id=42,image_ref='6bc8e4c4-2030-4644-8569-da91fde6f987',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY0D3vdAXP1Uw5iOPQrUFMzzsglvj6jvcAFaLJfftLI5qdjFbF3qmMqlBS6g6gXV6f3NDdy+mfkiStVBeHEEmPFhi29WKhEbf8vOEiEeuKxD5jDUbAuPzUzAbvJ63afJA==',key_name='tempest-TestStampPattern-274602689',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af152857bb640f591e8f0a09ff89837',ramdisk_id='',reservation_id='r-vpczjglr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f0ef243f-6c58-4991-97b1-0883d24dd6c9',image_min_disk='1',image_min_ram='0',image_owner_id='0af152857bb640f591e8f0a09ff89837',image_owner_project_name='tempest-TestStampPattern-1531717549',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1531717549-project-member',image_user_id='fae1f92a5fa44879a3a523589e12a5ef',network_allocated='True',owner_project_name='tempest-TestStampPattern-1531717549',owner_user_name='tempest-TestStampPattern-1531717549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:19:25Z,user_data=None,user_id='fae1f92a5fa44879a3a523589e12a5ef',uuid=53f00180-560e-486e-92a9-558bed951f36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converting VIF {"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=7eacccce-d3b6-4750-9a19-2852f48b57e3,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eacccce-d3') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG os_vif [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=7eacccce-d3b6-4750-9a19-2852f48b57e3,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eacccce-d3') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eacccce-d3, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7eacccce-d3, col_values=(('external_ids', {'iface-id': '7eacccce-d3b6-4750-9a19-2852f48b57e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f6:dd', 'vm-uuid': '53f00180-560e-486e-92a9-558bed951f36'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:27 user nova-compute[72178]: INFO os_vif [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=7eacccce-d3b6-4750-9a19-2852f48b57e3,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eacccce-d3')
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No VIF found with MAC fa:16:3e:ce:f6:dd, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.neutron [req-f587c2cb-6087-46ca-8794-5806c42b74d6 req-623536b3-879f-4b7a-bf17-1ee27005f523 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updated VIF entry in instance network info cache for port 7eacccce-d3b6-4750-9a19-2852f48b57e3. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG nova.network.neutron [req-f587c2cb-6087-46ca-8794-5806c42b74d6 req-623536b3-879f-4b7a-bf17-1ee27005f523 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updating instance_info_cache with network_info: [{"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:19:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f587c2cb-6087-46ca-8794-5806c42b74d6 req-623536b3-879f-4b7a-bf17-1ee27005f523 service nova] Releasing lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:19:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-5ba20f39-2d76-4c4a-a33a-864e3307143e req-adbf64e3-47bc-4527-99d0-78d0a16e9b8e service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received event network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ba20f39-2d76-4c4a-a33a-864e3307143e req-adbf64e3-47bc-4527-99d0-78d0a16e9b8e service nova] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ba20f39-2d76-4c4a-a33a-864e3307143e req-adbf64e3-47bc-4527-99d0-78d0a16e9b8e service nova] Lock "53f00180-560e-486e-92a9-558bed951f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ba20f39-2d76-4c4a-a33a-864e3307143e req-adbf64e3-47bc-4527-99d0-78d0a16e9b8e service nova] Lock "53f00180-560e-486e-92a9-558bed951f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-5ba20f39-2d76-4c4a-a33a-864e3307143e req-adbf64e3-47bc-4527-99d0-78d0a16e9b8e service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] No waiting events found dispatching network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:19:29 user nova-compute[72178]: WARNING nova.compute.manager [req-5ba20f39-2d76-4c4a-a33a-864e3307143e req-adbf64e3-47bc-4527-99d0-78d0a16e9b8e service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received unexpected event network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 for instance with vm_state building and task_state spawning.
Aug 01 12:19:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892371.2749817, 53f00180-560e-486e-92a9-558bed951f36 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:19:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] VM Resumed (Lifecycle Event)
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-2b567560-4192-41a2-bbf0-1311f8ad6fb9 req-6b198578-d1c7-433a-800a-3cdc304257f1 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received event network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2b567560-4192-41a2-bbf0-1311f8ad6fb9 req-6b198578-d1c7-433a-800a-3cdc304257f1 service nova] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2b567560-4192-41a2-bbf0-1311f8ad6fb9 req-6b198578-d1c7-433a-800a-3cdc304257f1 service nova] Lock "53f00180-560e-486e-92a9-558bed951f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2b567560-4192-41a2-bbf0-1311f8ad6fb9 req-6b198578-d1c7-433a-800a-3cdc304257f1 service nova] Lock "53f00180-560e-486e-92a9-558bed951f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.compute.manager [req-2b567560-4192-41a2-bbf0-1311f8ad6fb9 req-6b198578-d1c7-433a-800a-3cdc304257f1 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] No waiting events found dispatching network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:19:31 user nova-compute[72178]: WARNING nova.compute.manager [req-2b567560-4192-41a2-bbf0-1311f8ad6fb9 req-6b198578-d1c7-433a-800a-3cdc304257f1 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received unexpected event network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 for instance with vm_state building and task_state spawning.
Aug 01 12:19:31 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 53f00180-560e-486e-92a9-558bed951f36] Instance spawned successfully.
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:19:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892371.2797945, 53f00180-560e-486e-92a9-558bed951f36 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:19:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] VM Started (Lifecycle Event)
Aug 01 12:19:31 user nova-compute[72178]: INFO nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Took 6.71 seconds to spawn the instance on the hypervisor.
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:19:31 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:19:31 user nova-compute[72178]: INFO nova.compute.manager [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Took 7.49 seconds to build instance.
Aug 01 12:19:31 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-76bb0067-ad7f-4381-9198-b89488f3babb tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.694s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOSpNIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:19:33 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:19:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:19:33 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:19:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:19:33 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:19:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9befe68-2e5e-40b8-a6f2-e7e896d4ae6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:19:33 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfce76aa-bbe1-416e-af2c-d13b0a8e2a29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8] added
Aug 01 12:19:33 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9306a93e-8f3f-446b-b2d5-c10fd4ce39fa]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cd8620-027d-42a6-8bd5-ce7c9b9ee9e6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcOSpNIq {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bcOSpNIq" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1275c-bcae-4433-84b4-8d188f714fe2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bcOSpNIq'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bc4dc2-d98f-4f07-aeee-978e979b8ec6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c7b48-1a1f-402f-826f-037f85bb310c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:19:34 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:19:34 user nova-compute[72178]:  {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:19:34 user nova-compute[72178]: WARNING os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 12:19:34 user nova-compute[72178]: 
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3823756-11ba-4e6a-857e-45aeac85d8bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8, portal: 172.16.0.220,3260]
Aug 01 12:19:34 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8, portal: 172.16.0.220,3260] successful.
Aug 01 12:19:34 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a36ed1-83f6-4480-93db-9094788dbcb9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ff9871-f6e3-46f1-93d1-929c950b5da9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 (non-flash)
Aug 01 12:19:34 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 (non-flash)
Aug 01 12:19:34 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4629d984-7a5c-4147-9907-e061d86c585a]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:19:34 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOSpNIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:19:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:19:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23330363632356164', 'path': '/dev/sdb'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:19:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330363632356164', 'path': '/dev/sdb'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:19:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid 5b81c686-411a-4d3a-86da-4089747b1441 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:19:35 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:19:35 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:19:35 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:19:35 user nova-compute[72178]:   <serial>7f758af5-b626-4e09-96ca-9a6914cc99b8</serial>
Aug 01 12:19:35 user nova-compute[72178]: </disk>
Aug 01 12:19:35 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:19:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:19:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:19:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No VIF found with MAC fa:16:3e:53:1b:05, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:19:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-dd37d479-b3c4-4c9f-a35f-52cd8757fbd8 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.384s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:37 user nova-compute[72178]: INFO nova.compute.manager [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Detaching volume 7f758af5-b626-4e09-96ca-9a6914cc99b8
Aug 01 12:19:37 user nova-compute[72178]: INFO nova.virt.block_device [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Attempting to driver detach volume 7f758af5-b626-4e09-96ca-9a6914cc99b8 from mountpoint /dev/vdb
Aug 01 12:19:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Attempting to detach device vdb from instance 5b81c686-411a-4d3a-86da-4089747b1441 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:19:37 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:19:37 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:19:37 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:19:37 user nova-compute[72178]:   <serial>7f758af5-b626-4e09-96ca-9a6914cc99b8</serial>
Aug 01 12:19:37 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:19:37 user nova-compute[72178]: </disk>
Aug 01 12:19:37 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:19:37 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully detached device vdb from instance 5b81c686-411a-4d3a-86da-4089747b1441 from the persistent domain config.
Aug 01 12:19:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b81c686-411a-4d3a-86da-4089747b1441 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:19:37 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:19:37 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:19:37 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:19:37 user nova-compute[72178]:   <serial>7f758af5-b626-4e09-96ca-9a6914cc99b8</serial>
Aug 01 12:19:37 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:19:37 user nova-compute[72178]: </disk>
Aug 01 12:19:37 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892377.8988187, 5b81c686-411a-4d3a-86da-4089747b1441 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b81c686-411a-4d3a-86da-4089747b1441 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:19:37 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully detached device vdb from instance 5b81c686-411a-4d3a-86da-4089747b1441 from the live domain config.
Aug 01 12:19:37 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bcOSpNIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:19:37 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:19:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa557c7-6c31-4799-80ee-a8b8b5dc8dc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca34387e-9a7c-435f-b298-6785a3f28674]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 (non-flash)
Aug 01 12:19:37 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 (non-flash)
Aug 01 12:19:37 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f412d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8'): ({'sdb'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Removing single pathed devices sdb {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14de4c1-4532-4871-8ff9-cc62bbaac701]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:37 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a368636e-07e2-42e3-b46d-0ba7f4f50593]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flushing IO for device /dev/sdb {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62b78d7-7fc8-4985-a666-357fb7952d84]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9735bc04-0b2b-4da7-990c-cd51a59e29d1]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25b1e5a-70e6-4e1c-85f9-2537f5f63ca9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d1c665-c179-479b-b327-92e48f560622]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8, portal: 172.16.0.220,3260]
Aug 01 12:19:38 user nova-compute[72178]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8, portal: 172.16.0.220,3260] successful.
Aug 01 12:19:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f758af5-b626-4e09-96ca-9a6914cc99b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f81dab-8b05-48e3-9bff-153b45755f52]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== disconnect_volume: return (289ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG nova.objects.instance [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid 5b81c686-411a-4d3a-86da-4089747b1441 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-26e870da-11ce-47a7-a635-88913c431b03 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.708s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:40 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:19:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:19:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:19:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:19:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:19:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "051b1b49-f5b2-400d-ac88-b841439743ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "051b1b49-f5b2-400d-ac88-b841439743ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:19:41 user nova-compute[72178]: INFO nova.compute.claims [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Claim successful on node user
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:19:41 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:19:41 user nova-compute[72178]: INFO nova.virt.block_device [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Booting with volume 03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe at /dev/vda
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.policy [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef22394fbdfd4aad8c301596a2ee7b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0eb9e0006c46dabba55cc95cca217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG os_brick.utils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc3456c-ddc1-44d6-b703-d08d408aa8d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf44a8f-b8a2-4be2-a282-003b29f2cdfd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3341ddb6-06b8-4dd8-bf3a-27da431c5943]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3909026d-59ea-4dd5-99aa-62e6c60f6d24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:19:41 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:19:41 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9240b1f-f6a5-4757-821d-0582465c1dc1]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG os_brick.utils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:19:41 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updating existing volume attachment record: 762fd940-addf-4614-b305-d8bf532ee3d0 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:19:42 user nova-compute[72178]: INFO nova.compute.claims [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Claim successful on node user
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Successfully created port: 156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:19:42 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.policy [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '923afe9bd6654c02b9a2dc0d2c7aacd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5744024985c24187a2add045778a28df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:19:42 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Creating image(s)
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "/opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "/opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "/opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:42 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk 1073741824" returned: 0 in 0.054s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Successfully updated port: 156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquired lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Cannot resize image /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lazy-loading 'migration_context' on Instance uuid 06af0083-dfaa-4649-a993-52a6cc6fef0a {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-9550c325-c408-4be0-9f95-c845f1e00ffc req-c20ccd09-904f-424c-9914-cb6165981f43 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-changed-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.compute.manager [req-9550c325-c408-4be0-9f95-c845f1e00ffc req-c20ccd09-904f-424c-9914-cb6165981f43 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Refreshing instance network info cache due to event network-changed-156e216e-1d49-4a3f-bbc3-a9255430cc36. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9550c325-c408-4be0-9f95-c845f1e00ffc req-c20ccd09-904f-424c-9914-cb6165981f43 service nova] Acquiring lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Ensure instance console log exists: /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:19:43 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Successfully created port: 2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG nova.network.neutron [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updating instance_info_cache with network_info: [{"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Releasing lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Instance network_info: |[{"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9550c325-c408-4be0-9f95-c845f1e00ffc req-c20ccd09-904f-424c-9914-cb6165981f43 service nova] Acquired lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG nova.network.neutron [req-9550c325-c408-4be0-9f95-c845f1e00ffc req-c20ccd09-904f-424c-9914-cb6165981f43 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Refreshing network info cache for port 156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG nova.network.neutron [req-9550c325-c408-4be0-9f95-c845f1e00ffc req-c20ccd09-904f-424c-9914-cb6165981f43 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updated VIF entry in instance network info cache for port 156e216e-1d49-4a3f-bbc3-a9255430cc36. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG nova.network.neutron [req-9550c325-c408-4be0-9f95-c845f1e00ffc req-c20ccd09-904f-424c-9914-cb6165981f43 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updating instance_info_cache with network_info: [{"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:19:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-9550c325-c408-4be0-9f95-c845f1e00ffc req-c20ccd09-904f-424c-9914-cb6165981f43 service nova] Releasing lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Successfully updated port: 2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquired lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-c5ea8912-df59-4dff-ad3e-8510694ae692 req-cddb3af1-a486-4255-95e2-27ed0e3076df service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received event network-changed-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.compute.manager [req-c5ea8912-df59-4dff-ad3e-8510694ae692 req-cddb3af1-a486-4255-95e2-27ed0e3076df service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Refreshing instance network info cache due to event network-changed-2f526db4-0d51-4030-9fc7-7c4f6dfdd014. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c5ea8912-df59-4dff-ad3e-8510694ae692 req-cddb3af1-a486-4255-95e2-27ed0e3076df service nova] Acquiring lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updating instance_info_cache with network_info: [{"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Releasing lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Instance network_info: |[{"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c5ea8912-df59-4dff-ad3e-8510694ae692 req-cddb3af1-a486-4255-95e2-27ed0e3076df service nova] Acquired lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.neutron [req-c5ea8912-df59-4dff-ad3e-8510694ae692 req-cddb3af1-a486-4255-95e2-27ed0e3076df service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Refreshing network info cache for port 2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Start _get_guest_xml network_info=[{"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:45 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:19:45 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1665880290',display_name='tempest-ServersNegativeTestJSON-server-1665880290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1665880290',id=44,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5744024985c24187a2add045778a28df',ramdisk_id='',reservation_id='r-aekcdn91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1559526557',owner_user_name='tempest-ServersNegativeTestJSON-1559526557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:19:43Z,user_data=None,user_id='923afe9bd6654c02b9a2dc0d2c7aacd9',uuid=06af0083-dfaa-4649-a993-52a6cc6fef0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converting VIF {"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:23:bc,bridge_name='br-int',has_traffic_filtering=True,id=2f526db4-0d51-4030-9fc7-7c4f6dfdd014,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f526db4-0d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lazy-loading 'pci_devices' on Instance uuid 06af0083-dfaa-4649-a993-52a6cc6fef0a {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:19:45 user nova-compute[72178]:   <uuid>06af0083-dfaa-4649-a993-52a6cc6fef0a</uuid>
Aug 01 12:19:45 user nova-compute[72178]:   <name>instance-0000002c</name>
Aug 01 12:19:45 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:19:45 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:19:45 user nova-compute[72178]:   <metadata>
Aug 01 12:19:45 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:19:45 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:19:45 user nova-compute[72178]:       <nova:name>tempest-ServersNegativeTestJSON-server-1665880290</nova:name>
Aug 01 12:19:45 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:19:45</nova:creationTime>
Aug 01 12:19:45 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:19:45 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:19:45 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:19:45 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:19:45 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:19:45 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:19:45 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:19:45 user nova-compute[72178]:       <nova:owner>
Aug 01 12:19:45 user nova-compute[72178]:         <nova:user uuid="923afe9bd6654c02b9a2dc0d2c7aacd9">tempest-ServersNegativeTestJSON-1559526557-project-member</nova:user>
Aug 01 12:19:45 user nova-compute[72178]:         <nova:project uuid="5744024985c24187a2add045778a28df">tempest-ServersNegativeTestJSON-1559526557</nova:project>
Aug 01 12:19:45 user nova-compute[72178]:       </nova:owner>
Aug 01 12:19:45 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:19:45 user nova-compute[72178]:       <nova:ports>
Aug 01 12:19:45 user nova-compute[72178]:         <nova:port uuid="2f526db4-0d51-4030-9fc7-7c4f6dfdd014">
Aug 01 12:19:45 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 01 12:19:45 user nova-compute[72178]:         </nova:port>
Aug 01 12:19:45 user nova-compute[72178]:       </nova:ports>
Aug 01 12:19:45 user nova-compute[72178]:     </nova:instance>
Aug 01 12:19:45 user nova-compute[72178]:   </metadata>
Aug 01 12:19:45 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:19:45 user nova-compute[72178]:     <system>
Aug 01 12:19:45 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:19:45 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:19:45 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:19:45 user nova-compute[72178]:       <entry name="serial">06af0083-dfaa-4649-a993-52a6cc6fef0a</entry>
Aug 01 12:19:45 user nova-compute[72178]:       <entry name="uuid">06af0083-dfaa-4649-a993-52a6cc6fef0a</entry>
Aug 01 12:19:45 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:19:45 user nova-compute[72178]:     </system>
Aug 01 12:19:45 user nova-compute[72178]:   </sysinfo>
Aug 01 12:19:45 user nova-compute[72178]:   <os>
Aug 01 12:19:45 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:19:45 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:19:45 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:19:45 user nova-compute[72178]:   </os>
Aug 01 12:19:45 user nova-compute[72178]:   <features>
Aug 01 12:19:45 user nova-compute[72178]:     <acpi/>
Aug 01 12:19:45 user nova-compute[72178]:     <apic/>
Aug 01 12:19:45 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:19:45 user nova-compute[72178]:   </features>
Aug 01 12:19:45 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:19:45 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:19:45 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:19:45 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:19:45 user nova-compute[72178]:   </clock>
Aug 01 12:19:45 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:19:45 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:19:45 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:19:45 user nova-compute[72178]:   </cpu>
Aug 01 12:19:45 user nova-compute[72178]:   <devices>
Aug 01 12:19:45 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:19:45 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:19:45 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk"/>
Aug 01 12:19:45 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:19:45 user nova-compute[72178]:     </disk>
Aug 01 12:19:45 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:19:45 user nova-compute[72178]:       <mac address="fa:16:3e:2c:23:bc"/>
Aug 01 12:19:45 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:19:45 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:19:45 user nova-compute[72178]:       <target dev="tap2f526db4-0d"/>
Aug 01 12:19:45 user nova-compute[72178]:     </interface>
Aug 01 12:19:45 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:19:45 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/console.log" append="off"/>
Aug 01 12:19:45 user nova-compute[72178]:     </serial>
Aug 01 12:19:45 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:19:45 user nova-compute[72178]:     <video>
Aug 01 12:19:45 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:19:45 user nova-compute[72178]:     </video>
Aug 01 12:19:45 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:19:45 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:19:45 user nova-compute[72178]:     </rng>
Aug 01 12:19:45 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:19:45 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:19:45 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:19:45 user nova-compute[72178]:     </memballoon>
Aug 01 12:19:45 user nova-compute[72178]:   </devices>
Aug 01 12:19:45 user nova-compute[72178]: </domain>
Aug 01 12:19:45 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1665880290',display_name='tempest-ServersNegativeTestJSON-server-1665880290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1665880290',id=44,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5744024985c24187a2add045778a28df',ramdisk_id='',reservation_id='r-aekcdn91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1559526557',owner_user_name='tempest-ServersNegativeTestJSON-1559526557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:19:43Z,user_data=None,user_id='923afe9bd6654c02b9a2dc0d2c7aacd9',uuid=06af0083-dfaa-4649-a993-52a6cc6fef0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converting VIF {"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:23:bc,bridge_name='br-int',has_traffic_filtering=True,id=2f526db4-0d51-4030-9fc7-7c4f6dfdd014,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f526db4-0d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG os_vif [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:23:bc,bridge_name='br-int',has_traffic_filtering=True,id=2f526db4-0d51-4030-9fc7-7c4f6dfdd014,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f526db4-0d') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f526db4-0d, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f526db4-0d, col_values=(('external_ids', {'iface-id': '2f526db4-0d51-4030-9fc7-7c4f6dfdd014', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:23:bc', 'vm-uuid': '06af0083-dfaa-4649-a993-52a6cc6fef0a'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:45 user nova-compute[72178]: INFO os_vif [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:23:bc,bridge_name='br-int',has_traffic_filtering=True,id=2f526db4-0d51-4030-9fc7-7c4f6dfdd014,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f526db4-0d')
Aug 01 12:19:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] No VIF found with MAC fa:16:3e:2c:23:bc, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG nova.network.neutron [req-c5ea8912-df59-4dff-ad3e-8510694ae692 req-cddb3af1-a486-4255-95e2-27ed0e3076df service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updated VIF entry in instance network info cache for port 2f526db4-0d51-4030-9fc7-7c4f6dfdd014. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG nova.network.neutron [req-c5ea8912-df59-4dff-ad3e-8510694ae692 req-cddb3af1-a486-4255-95e2-27ed0e3076df service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updating instance_info_cache with network_info: [{"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-c5ea8912-df59-4dff-ad3e-8510694ae692 req-cddb3af1-a486-4255-95e2-27ed0e3076df service nova] Releasing lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892389.3705044, 06af0083-dfaa-4649-a993-52a6cc6fef0a => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:19:49 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] VM Resumed (Lifecycle Event)
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-69d64fae-4298-49a3-9790-4c4a8795aedb req-a881ae17-f3a7-4fd8-873d-63620bdc5013 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received event network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-69d64fae-4298-49a3-9790-4c4a8795aedb req-a881ae17-f3a7-4fd8-873d-63620bdc5013 service nova] Acquiring lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-69d64fae-4298-49a3-9790-4c4a8795aedb req-a881ae17-f3a7-4fd8-873d-63620bdc5013 service nova] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-69d64fae-4298-49a3-9790-4c4a8795aedb req-a881ae17-f3a7-4fd8-873d-63620bdc5013 service nova] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-69d64fae-4298-49a3-9790-4c4a8795aedb req-a881ae17-f3a7-4fd8-873d-63620bdc5013 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] No waiting events found dispatching network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:19:49 user nova-compute[72178]: WARNING nova.compute.manager [req-69d64fae-4298-49a3-9790-4c4a8795aedb req-a881ae17-f3a7-4fd8-873d-63620bdc5013 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received unexpected event network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 for instance with vm_state building and task_state spawning.
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-e0627c9c-273b-4aff-a244-76f6ec02f49f req-0ec72c50-ed4b-435f-b52c-27124a95f9ef service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received event network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0627c9c-273b-4aff-a244-76f6ec02f49f req-0ec72c50-ed4b-435f-b52c-27124a95f9ef service nova] Acquiring lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0627c9c-273b-4aff-a244-76f6ec02f49f req-0ec72c50-ed4b-435f-b52c-27124a95f9ef service nova] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e0627c9c-273b-4aff-a244-76f6ec02f49f req-0ec72c50-ed4b-435f-b52c-27124a95f9ef service nova] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [req-e0627c9c-273b-4aff-a244-76f6ec02f49f req-0ec72c50-ed4b-435f-b52c-27124a95f9ef service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] No waiting events found dispatching network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:19:49 user nova-compute[72178]: WARNING nova.compute.manager [req-e0627c9c-273b-4aff-a244-76f6ec02f49f req-0ec72c50-ed4b-435f-b52c-27124a95f9ef service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received unexpected event network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 for instance with vm_state building and task_state spawning.
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:19:49 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:19:49 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8133MB free_disk=25.126876831054688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Instance spawned successfully.
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:19:49 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892389.3719296, 06af0083-dfaa-4649-a993-52a6cc6fef0a => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:19:49 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] VM Started (Lifecycle Event)
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:19:49 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 5b81c686-411a-4d3a-86da-4089747b1441 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 53f00180-560e-486e-92a9-558bed951f36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 051b1b49-f5b2-400d-ac88-b841439743ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:19:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Creating image(s)
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Ensure instance console log exists: /opt/stack/data/nova/instances/051b1b49-f5b2-400d-ac88-b841439743ee/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Start _get_guest_xml network_info=[{"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDeisuSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '051b1b49-f5b2-400d-ac88-b841439743ee', 'attached_at': '', 'detached_at': '', 'volume_id': '03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe', 'serial': '03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'}, 'boot_index': 0, 'attachment_id': '762fd940-addf-4614-b305-d8bf532ee3d0', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:19:49 user nova-compute[72178]: INFO nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 01 12:19:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:50 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:19:50 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:19:50 user nova-compute[72178]: INFO nova.compute.manager [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Took 7.96 seconds to build instance.
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDeisuSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:19:50 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:19:50 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:19:50 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a8ce2a-fcba-4682-a8d0-adddda9876dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:19:50 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c34dc6c-ff6b-462c-8a2a-006f74eb34d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe] added
Aug 01 12:19:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.064s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3edcfc-1ed8-4f20-a01b-55b3a000ab20]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9526fb68-d982-4e45-aa06-05823141b930 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.214s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff10fc6-77f4-468b-b8cd-00a3182806cf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDeisuSj {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TDeisuSj" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9275be01-57a8-40df-8ec6-1665fab8ba05]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TDeisuSj'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb5f98a-8ce2-4496-9acb-d60306336d65]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[950c61c5-7ed6-4c1c-9016-e53d623787f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:19:50 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:19:50 user nova-compute[72178]:  {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:19:50 user nova-compute[72178]: WARNING os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 12:19:50 user nova-compute[72178]: 
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.803s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94a7dcc-82dd-49c7-bcd6-b049cf9404f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260]
Aug 01 12:19:50 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260] successful.
Aug 01 12:19:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf7113-bb5f-45d7-ad08-e2dcf8926d3c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c92421-dea3-4033-a29b-eb6a53744d72]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:19:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:19:50 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f41e5b-71dc-4b3b-bbf0-0f4d37a82f8e]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDeisuSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:19:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26235306163326135', 'path': '/dev/sdb'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235306163326135', 'path': '/dev/sdb'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-326278615',display_name='tempest-TestVolumeBootPattern-server-326278615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-326278615',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-fuoqcuo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:19:42Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=051b1b49-f5b2-400d-ac88-b841439743ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:a7,bridge_name='br-int',has_traffic_filtering=True,id=156e216e-1d49-4a3f-bbc3-a9255430cc36,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156e216e-1d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'pci_devices' on Instance uuid 051b1b49-f5b2-400d-ac88-b841439743ee {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:19:51 user nova-compute[72178]:   <uuid>051b1b49-f5b2-400d-ac88-b841439743ee</uuid>
Aug 01 12:19:51 user nova-compute[72178]:   <name>instance-0000002b</name>
Aug 01 12:19:51 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:19:51 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:19:51 user nova-compute[72178]:   <metadata>
Aug 01 12:19:51 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:19:51 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:19:51 user nova-compute[72178]:       <nova:name>tempest-TestVolumeBootPattern-server-326278615</nova:name>
Aug 01 12:19:51 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:19:50</nova:creationTime>
Aug 01 12:19:51 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:19:51 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:19:51 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:19:51 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:19:51 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:19:51 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:19:51 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:19:51 user nova-compute[72178]:       <nova:owner>
Aug 01 12:19:51 user nova-compute[72178]:         <nova:user uuid="ef22394fbdfd4aad8c301596a2ee7b61">tempest-TestVolumeBootPattern-1003407750-project-member</nova:user>
Aug 01 12:19:51 user nova-compute[72178]:         <nova:project uuid="1e0eb9e0006c46dabba55cc95cca217f">tempest-TestVolumeBootPattern-1003407750</nova:project>
Aug 01 12:19:51 user nova-compute[72178]:       </nova:owner>
Aug 01 12:19:51 user nova-compute[72178]:       <nova:ports>
Aug 01 12:19:51 user nova-compute[72178]:         <nova:port uuid="156e216e-1d49-4a3f-bbc3-a9255430cc36">
Aug 01 12:19:51 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 12:19:51 user nova-compute[72178]:         </nova:port>
Aug 01 12:19:51 user nova-compute[72178]:       </nova:ports>
Aug 01 12:19:51 user nova-compute[72178]:     </nova:instance>
Aug 01 12:19:51 user nova-compute[72178]:   </metadata>
Aug 01 12:19:51 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:19:51 user nova-compute[72178]:     <system>
Aug 01 12:19:51 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:19:51 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:19:51 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:19:51 user nova-compute[72178]:       <entry name="serial">051b1b49-f5b2-400d-ac88-b841439743ee</entry>
Aug 01 12:19:51 user nova-compute[72178]:       <entry name="uuid">051b1b49-f5b2-400d-ac88-b841439743ee</entry>
Aug 01 12:19:51 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:19:51 user nova-compute[72178]:     </system>
Aug 01 12:19:51 user nova-compute[72178]:   </sysinfo>
Aug 01 12:19:51 user nova-compute[72178]:   <os>
Aug 01 12:19:51 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:19:51 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:19:51 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:19:51 user nova-compute[72178]:   </os>
Aug 01 12:19:51 user nova-compute[72178]:   <features>
Aug 01 12:19:51 user nova-compute[72178]:     <acpi/>
Aug 01 12:19:51 user nova-compute[72178]:     <apic/>
Aug 01 12:19:51 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:19:51 user nova-compute[72178]:   </features>
Aug 01 12:19:51 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:19:51 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:19:51 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:19:51 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:19:51 user nova-compute[72178]:   </clock>
Aug 01 12:19:51 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:19:51 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:19:51 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:19:51 user nova-compute[72178]:   </cpu>
Aug 01 12:19:51 user nova-compute[72178]:   <devices>
Aug 01 12:19:51 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:19:51 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:19:51 user nova-compute[72178]:       <source dev="/dev/sdb"/>
Aug 01 12:19:51 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:19:51 user nova-compute[72178]:       <serial>03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe</serial>
Aug 01 12:19:51 user nova-compute[72178]:     </disk>
Aug 01 12:19:51 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:19:51 user nova-compute[72178]:       <mac address="fa:16:3e:cf:ee:a7"/>
Aug 01 12:19:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:19:51 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:19:51 user nova-compute[72178]:       <target dev="tap156e216e-1d"/>
Aug 01 12:19:51 user nova-compute[72178]:     </interface>
Aug 01 12:19:51 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:19:51 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/051b1b49-f5b2-400d-ac88-b841439743ee/console.log" append="off"/>
Aug 01 12:19:51 user nova-compute[72178]:     </serial>
Aug 01 12:19:51 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:19:51 user nova-compute[72178]:     <video>
Aug 01 12:19:51 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:19:51 user nova-compute[72178]:     </video>
Aug 01 12:19:51 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:19:51 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:19:51 user nova-compute[72178]:     </rng>
Aug 01 12:19:51 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:19:51 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:19:51 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:19:51 user nova-compute[72178]:     </memballoon>
Aug 01 12:19:51 user nova-compute[72178]:   </devices>
Aug 01 12:19:51 user nova-compute[72178]: </domain>
Aug 01 12:19:51 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-326278615',display_name='tempest-TestVolumeBootPattern-server-326278615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-326278615',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-fuoqcuo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:19:42Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=051b1b49-f5b2-400d-ac88-b841439743ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:a7,bridge_name='br-int',has_traffic_filtering=True,id=156e216e-1d49-4a3f-bbc3-a9255430cc36,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156e216e-1d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG os_vif [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:a7,bridge_name='br-int',has_traffic_filtering=True,id=156e216e-1d49-4a3f-bbc3-a9255430cc36,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156e216e-1d') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap156e216e-1d, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap156e216e-1d, col_values=(('external_ids', {'iface-id': '156e216e-1d49-4a3f-bbc3-a9255430cc36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:ee:a7', 'vm-uuid': '051b1b49-f5b2-400d-ac88-b841439743ee'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:51 user nova-compute[72178]: INFO os_vif [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:a7,bridge_name='br-int',has_traffic_filtering=True,id=156e216e-1d49-4a3f-bbc3-a9255430cc36,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156e216e-1d')
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:19:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No VIF found with MAC fa:16:3e:cf:ee:a7, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:19:52 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:52 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-cc0aae75-c9ef-4db9-98b7-82c9bd522e8d req-ea98024a-075b-46e6-8f55-b949d62a3751 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cc0aae75-c9ef-4db9-98b7-82c9bd522e8d req-ea98024a-075b-46e6-8f55-b949d62a3751 service nova] Acquiring lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cc0aae75-c9ef-4db9-98b7-82c9bd522e8d req-ea98024a-075b-46e6-8f55-b949d62a3751 service nova] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-cc0aae75-c9ef-4db9-98b7-82c9bd522e8d req-ea98024a-075b-46e6-8f55-b949d62a3751 service nova] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-cc0aae75-c9ef-4db9-98b7-82c9bd522e8d req-ea98024a-075b-46e6-8f55-b949d62a3751 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] No waiting events found dispatching network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:19:53 user nova-compute[72178]: WARNING nova.compute.manager [req-cc0aae75-c9ef-4db9-98b7-82c9bd522e8d req-ea98024a-075b-46e6-8f55-b949d62a3751 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received unexpected event network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 for instance with vm_state building and task_state spawning.
Aug 01 12:19:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] There are 0 instances to clean {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-1b9d47fa-774f-4b7f-8053-edbe8bde61cc req-aeb8725b-3620-4e85-a1ef-c41895685395 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1b9d47fa-774f-4b7f-8053-edbe8bde61cc req-aeb8725b-3620-4e85-a1ef-c41895685395 service nova] Acquiring lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1b9d47fa-774f-4b7f-8053-edbe8bde61cc req-aeb8725b-3620-4e85-a1ef-c41895685395 service nova] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1b9d47fa-774f-4b7f-8053-edbe8bde61cc req-aeb8725b-3620-4e85-a1ef-c41895685395 service nova] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-1b9d47fa-774f-4b7f-8053-edbe8bde61cc req-aeb8725b-3620-4e85-a1ef-c41895685395 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] No waiting events found dispatching network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:19:55 user nova-compute[72178]: WARNING nova.compute.manager [req-1b9d47fa-774f-4b7f-8053-edbe8bde61cc req-aeb8725b-3620-4e85-a1ef-c41895685395 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received unexpected event network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 for instance with vm_state building and task_state spawning.
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892395.3011732, 051b1b49-f5b2-400d-ac88-b841439743ee => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:19:55 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] VM Resumed (Lifecycle Event)
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:19:55 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Instance spawned successfully.
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:19:55 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892395.3039932, 051b1b49-f5b2-400d-ac88-b841439743ee => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:19:55 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] VM Started (Lifecycle Event)
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:19:55 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:19:55 user nova-compute[72178]: INFO nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Took 5.74 seconds to spawn the instance on the hypervisor.
Aug 01 12:19:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:19:55 user nova-compute[72178]: INFO nova.compute.manager [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Took 14.37 seconds to build instance.
Aug 01 12:19:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6d88c7bb-9c47-471a-96c8-8b1ee59b7ac3 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "051b1b49-f5b2-400d-ac88-b841439743ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.466s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:19:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:19:57 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:58 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:19:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=72178) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 12:19:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-5ef537af-95f1-4022-8a53-3d927eb30ead req-10161a26-9b71-4c71-9d89-cd12c118b541 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received event network-changed-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-5ef537af-95f1-4022-8a53-3d927eb30ead req-10161a26-9b71-4c71-9d89-cd12c118b541 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Refreshing instance network info cache due to event network-changed-29c5428e-e0b4-4d19-825d-23eeb41dcec3. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ef537af-95f1-4022-8a53-3d927eb30ead req-10161a26-9b71-4c71-9d89-cd12c118b541 service nova] Acquiring lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ef537af-95f1-4022-8a53-3d927eb30ead req-10161a26-9b71-4c71-9d89-cd12c118b541 service nova] Acquired lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG nova.network.neutron [req-5ef537af-95f1-4022-8a53-3d927eb30ead req-10161a26-9b71-4c71-9d89-cd12c118b541 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Refreshing network info cache for port 29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'flavor' on Instance uuid 508f4bcf-bc5b-44d5-85d6-ab6b90693afb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:20:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Ignoring supplied device name: /dev/vdb
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG nova.network.neutron [req-5ef537af-95f1-4022-8a53-3d927eb30ead req-10161a26-9b71-4c71-9d89-cd12c118b541 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Updated VIF entry in instance network info cache for port 29c5428e-e0b4-4d19-825d-23eeb41dcec3. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG nova.network.neutron [req-5ef537af-95f1-4022-8a53-3d927eb30ead req-10161a26-9b71-4c71-9d89-cd12c118b541 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Updating instance_info_cache with network_info: [{"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5ef537af-95f1-4022-8a53-3d927eb30ead req-10161a26-9b71-4c71-9d89-cd12c118b541 service nova] Releasing lock "refresh_cache-508f4bcf-bc5b-44d5-85d6-ab6b90693afb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:24 user nova-compute[72178]: INFO nova.compute.manager [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Attaching volume 86436fbf-0e6a-45e6-bc09-8b2de5ca0518 to /dev/vdb
Aug 01 12:20:24 user nova-compute[72178]: DEBUG os_brick.utils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a56c86-bb91-4815-9b06-cf9683e31e7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[474ce289-9e6e-411f-8e80-76e029c5d80b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9018b1-b6c4-44fd-986f-dadd99cd4213]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[137caf3a-fba3-4cb9-9bbc-0dc31f33f242]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:20:24 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:20:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d489776-d2c2-4cc7-b865-dc501b50fc1e]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG os_brick.utils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:20:24 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Updating existing volume attachment record: 3ec2caf7-de36-4bb8-ba8c-9e2b894a7c34 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:20:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:27 user nova-compute[72178]: INFO nova.compute.manager [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Terminating instance
Aug 01 12:20:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-955dece5-924a-4bac-9278-c02e632cf68b req-f64af9f7-9a84-40a7-9271-b56838212253 service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received event network-vif-unplugged-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-955dece5-924a-4bac-9278-c02e632cf68b req-f64af9f7-9a84-40a7-9271-b56838212253 service nova] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-955dece5-924a-4bac-9278-c02e632cf68b req-f64af9f7-9a84-40a7-9271-b56838212253 service nova] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-955dece5-924a-4bac-9278-c02e632cf68b req-f64af9f7-9a84-40a7-9271-b56838212253 service nova] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-955dece5-924a-4bac-9278-c02e632cf68b req-f64af9f7-9a84-40a7-9271-b56838212253 service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] No waiting events found dispatching network-vif-unplugged-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:20:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-955dece5-924a-4bac-9278-c02e632cf68b req-f64af9f7-9a84-40a7-9271-b56838212253 service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received event network-vif-unplugged-554ca614-c20e-47aa-a828-c58f9c155992 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:28 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Instance destroyed successfully.
Aug 01 12:20:28 user nova-compute[72178]: DEBUG nova.objects.instance [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'resources' on Instance uuid 5b81c686-411a-4d3a-86da-4089747b1441 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:17:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1099733893',display_name='tempest-AttachVolumeNegativeTest-server-1099733893',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1099733893',id=40,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgpB8jr/c5uqEqkt3AR2Mxyauug20C2DGs6C2ofiwWpcv/JQChu0TePDU2xZrWmjhoZka7c9KkWNEyQujZOaWV4IsagHuc0Sd4KGQQsApjow4ZXuOBzXAxjfl6o726o+Q==',key_name='tempest-keypair-1048518203',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:17:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-s7piiope',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=5b81c686-411a-4d3a-86da-4089747b1441,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "554ca614-c20e-47aa-a828-c58f9c155992", "address": "fa:16:3e:53:1b:05", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap554ca614-c2", "ovs_interfaceid": "554ca614-c20e-47aa-a828-c58f9c155992", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:1b:05,bridge_name='br-int',has_traffic_filtering=True,id=554ca614-c20e-47aa-a828-c58f9c155992,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554ca614-c2') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG os_vif [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:1b:05,bridge_name='br-int',has_traffic_filtering=True,id=554ca614-c20e-47aa-a828-c58f9c155992,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554ca614-c2') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap554ca614-c2, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:28 user nova-compute[72178]: INFO os_vif [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:1b:05,bridge_name='br-int',has_traffic_filtering=True,id=554ca614-c20e-47aa-a828-c58f9c155992,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap554ca614-c2')
Aug 01 12:20:28 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Deleting instance files /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441_del
Aug 01 12:20:28 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Deletion of /opt/stack/data/nova/instances/5b81c686-411a-4d3a-86da-4089747b1441_del complete
Aug 01 12:20:28 user nova-compute[72178]: INFO nova.compute.manager [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 01 12:20:28 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:20:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:20:29 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Took 0.79 seconds to deallocate network for instance.
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-7906f773-ad24-48f7-a778-ba6d28d40c3e req-9ec817e2-51a5-4b3b-87b4-fad8285947d3 service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received event network-vif-deleted-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Refreshing inventories for resource provider f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Updating ProviderTree inventory for provider f106307e-ff81-42a0-bae9-51f40c919103 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Refreshing aggregate associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, aggregates: None {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Refreshing trait associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.523s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:29 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Deleted allocations for instance 5b81c686-411a-4d3a-86da-4089747b1441
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-1a5544b5-4a0e-4487-84bf-3696aa8930d1 req-70d1e8c1-8872-486a-993b-4098dbebad52 service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received event network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1a5544b5-4a0e-4487-84bf-3696aa8930d1 req-70d1e8c1-8872-486a-993b-4098dbebad52 service nova] Acquiring lock "5b81c686-411a-4d3a-86da-4089747b1441-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1a5544b5-4a0e-4487-84bf-3696aa8930d1 req-70d1e8c1-8872-486a-993b-4098dbebad52 service nova] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1a5544b5-4a0e-4487-84bf-3696aa8930d1 req-70d1e8c1-8872-486a-993b-4098dbebad52 service nova] Lock "5b81c686-411a-4d3a-86da-4089747b1441-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:29 user nova-compute[72178]: DEBUG nova.compute.manager [req-1a5544b5-4a0e-4487-84bf-3696aa8930d1 req-70d1e8c1-8872-486a-993b-4098dbebad52 service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] No waiting events found dispatching network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:20:29 user nova-compute[72178]: WARNING nova.compute.manager [req-1a5544b5-4a0e-4487-84bf-3696aa8930d1 req-70d1e8c1-8872-486a-993b-4098dbebad52 service nova] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Received unexpected event network-vif-plugged-554ca614-c20e-47aa-a828-c58f9c155992 for instance with vm_state deleted and task_state None.
Aug 01 12:20:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-cda4e843-0c76-4b4b-b18c-799a630bc07e tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "5b81c686-411a-4d3a-86da-4089747b1441" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.403s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoxKXFeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:20:32 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:20:32 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:20:32 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[047c3612-492b-400f-8660-a06e0c1acddf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:20:32 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8600dd26-4472-4155-855e-1a5df2c0fabc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518] added
Aug 01 12:20:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa888c1-d76a-4de6-ab1f-4d131e2a18b7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf65827-3673-4150-b656-97ec6d7fd244]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoxKXFeV {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoxKXFeV" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce610e58-1608-4c2a-a4c8-bc94e81feb6c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hoxKXFeV'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cf7be9-31f9-4db9-8ac5-35bdb5c999bd]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4e26e-d3f3-4507-8cad-2966639a14e9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:20:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:20:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec97f669-98d9-455e-91e0-54b6e6938deb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518, portal: 172.16.0.220,3260]
Aug 01 12:20:32 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518, portal: 172.16.0.220,3260] successful.
Aug 01 12:20:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[024806f1-fd70-419b-b456-7a016ad81c9e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3390203-9534-41d0-884b-651179fc8802]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:20:32 user nova-compute[72178]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 (non-flash)
Aug 01 12:20:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:20:32 user nova-compute[72178]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 (non-flash)
Aug 01 12:20:32 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[176dd191-5c0c-4a8c-a831-7452bebd8d32]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:32 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoxKXFeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23261373730356233', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261373730356233', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG nova.objects.instance [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'flavor' on Instance uuid 508f4bcf-bc5b-44d5-85d6-ab6b90693afb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:20:33 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:20:33 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:20:33 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:20:33 user nova-compute[72178]:   <serial>86436fbf-0e6a-45e6-bc09-8b2de5ca0518</serial>
Aug 01 12:20:33 user nova-compute[72178]: </disk>
Aug 01 12:20:33 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No VIF found with MAC fa:16:3e:6c:d3:db, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:20:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-14c28a94-ea3e-43ff-80b5-9e8e1007625b tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.117s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:20:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:20:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:20:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:20:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updating instance_info_cache with network_info: [{"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:20:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:20:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:20:43 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892428.3137476, 5b81c686-411a-4d3a-86da-4089747b1441 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:20:43 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] VM Stopped (Lifecycle Event)
Aug 01 12:20:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-dd783f28-19e6-446b-b5fe-78bc208d9a2e None None] [instance: 5b81c686-411a-4d3a-86da-4089747b1441] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:20:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:20:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:20:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:46 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:20:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8054MB free_disk=25.10818099975586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 53f00180-560e-486e-92a9-558bed951f36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 051b1b49-f5b2-400d-ac88-b841439743ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:20:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:20:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:58 user nova-compute[72178]: INFO nova.compute.manager [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Detaching volume 86436fbf-0e6a-45e6-bc09-8b2de5ca0518
Aug 01 12:20:58 user nova-compute[72178]: INFO nova.virt.block_device [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Attempting to driver detach volume 86436fbf-0e6a-45e6-bc09-8b2de5ca0518 from mountpoint /dev/vdb
Aug 01 12:20:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Attempting to detach device vdb from instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:20:58 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:20:58 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:20:58 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:20:58 user nova-compute[72178]:   <serial>86436fbf-0e6a-45e6-bc09-8b2de5ca0518</serial>
Aug 01 12:20:58 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:20:58 user nova-compute[72178]: </disk>
Aug 01 12:20:58 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:20:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Successfully detached device vdb from instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb from the persistent domain config.
Aug 01 12:20:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:20:58 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:20:58 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:20:58 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:20:58 user nova-compute[72178]:   <serial>86436fbf-0e6a-45e6-bc09-8b2de5ca0518</serial>
Aug 01 12:20:58 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:20:58 user nova-compute[72178]: </disk>
Aug 01 12:20:58 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892458.7364128, 508f4bcf-bc5b-44d5-85d6-ab6b90693afb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:20:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Successfully detached device vdb from instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb from the live domain config.
Aug 01 12:20:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoxKXFeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:20:58 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d39418-327b-4651-9293-e8ee8a522f69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ff6f43-8fc8-4438-9072-0bd3a86f45ad]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:20:58 user nova-compute[72178]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 (non-flash)
Aug 01 12:20:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:20:58 user nova-compute[72178]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 (non-flash)
Aug 01 12:20:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f44b75b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a6d8b6-b531-4089-b16f-bb35dc4d86fa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55bc556-8097-42a4-aa15-babc387ce373]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[443c3d8b-2ffd-4bab-8199-e4902df1b2d5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da91661-a2e2-4adf-a120-37ad37c2b357]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8055d41d-9453-4bea-a5a1-b8df7d628d3f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[82395c73-7895-47a1-aed6-614d99a924d5]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518, portal: 172.16.0.220,3260]
Aug 01 12:20:58 user nova-compute[72178]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518, portal: 172.16.0.220,3260] successful.
Aug 01 12:20:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[997cba08-4139-4404-a5b7-d5d4b2d60fa2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] <== disconnect_volume: return (266ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG nova.objects.instance [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'flavor' on Instance uuid 508f4bcf-bc5b-44d5-85d6-ab6b90693afb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-92663fd1-7264-4310-80e5-965c3bdd04f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.561s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.447s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:20:59 user nova-compute[72178]: INFO nova.compute.manager [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Terminating instance
Aug 01 12:20:59 user nova-compute[72178]: DEBUG nova.compute.manager [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:20:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-b57ba7c1-6c78-4a80-bf5d-5ac5a71acbeb req-ce79a43b-2d21-43da-8392-f4f6b7eeab5f service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received event network-vif-unplugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b57ba7c1-6c78-4a80-bf5d-5ac5a71acbeb req-ce79a43b-2d21-43da-8392-f4f6b7eeab5f service nova] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b57ba7c1-6c78-4a80-bf5d-5ac5a71acbeb req-ce79a43b-2d21-43da-8392-f4f6b7eeab5f service nova] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b57ba7c1-6c78-4a80-bf5d-5ac5a71acbeb req-ce79a43b-2d21-43da-8392-f4f6b7eeab5f service nova] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-b57ba7c1-6c78-4a80-bf5d-5ac5a71acbeb req-ce79a43b-2d21-43da-8392-f4f6b7eeab5f service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] No waiting events found dispatching network-vif-unplugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.compute.manager [req-b57ba7c1-6c78-4a80-bf5d-5ac5a71acbeb req-ce79a43b-2d21-43da-8392-f4f6b7eeab5f service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received event network-vif-unplugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:21:00 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Instance destroyed successfully.
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.objects.instance [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'resources' on Instance uuid 508f4bcf-bc5b-44d5-85d6-ab6b90693afb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:18:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-602252060',display_name='tempest-VolumesSnapshotTestJSON-instance-602252060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-602252060',id=41,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvVauUBtkzfDNXlimhMa04XBxSM1vi+2wj6M+u1pF/YMdOXzIYR6PXVEEPL/l1WE9K6cNewAMJANXI9wbLx9W8OJVY4vMRBm2cVRwUqy0UPn+gMYx/UtGPYJ3jjAsYaUg==',key_name='tempest-keypair-41142864',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:18:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3e2397edfe04144b7eaea8d06ceb971',ramdisk_id='',reservation_id='r-0j2dojps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1949254885',owner_user_name='tempest-VolumesSnapshotTestJSON-1949254885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:18:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='517883471ec747278f78d0329efcccf6',uuid=508f4bcf-bc5b-44d5-85d6-ab6b90693afb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converting VIF {"id": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "address": "fa:16:3e:6c:d3:db", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29c5428e-e0", "ovs_interfaceid": "29c5428e-e0b4-4d19-825d-23eeb41dcec3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d3:db,bridge_name='br-int',has_traffic_filtering=True,id=29c5428e-e0b4-4d19-825d-23eeb41dcec3,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c5428e-e0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_vif [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d3:db,bridge_name='br-int',has_traffic_filtering=True,id=29c5428e-e0b4-4d19-825d-23eeb41dcec3,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c5428e-e0') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29c5428e-e0, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:00 user nova-compute[72178]: INFO os_vif [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:d3:db,bridge_name='br-int',has_traffic_filtering=True,id=29c5428e-e0b4-4d19-825d-23eeb41dcec3,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29c5428e-e0')
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoxKXFeV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:21:00 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86436fbf-0e6a-45e6-bc09-8b2de5ca0518', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b73f59-4126-41a2-a998-94ecb8cb9a97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1bdbd2-1a6b-4204-a718-e632e11d11e5]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:00 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:00 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f412c1f0>, {}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Disconnecting from: [] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] <== disconnect_volume: return (55ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:21:00 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Deleting instance files /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb_del
Aug 01 12:21:00 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Deletion of /opt/stack/data/nova/instances/508f4bcf-bc5b-44d5-85d6-ab6b90693afb_del complete
Aug 01 12:21:00 user nova-compute[72178]: INFO nova.compute.manager [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 01 12:21:00 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:21:00 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:21:01 user nova-compute[72178]: DEBUG nova.objects.instance [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquired lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:01 user nova-compute[72178]: DEBUG nova.network.neutron [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:21:01 user nova-compute[72178]: DEBUG nova.objects.instance [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'info_cache' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:01 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:01 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Took 0.95 seconds to deallocate network for instance.
Aug 01 12:21:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-0afaf506-30c8-41a9-944d-8c0357e36f0d req-076af671-4c20-45dd-9742-c9d5d4dd37ef service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received event network-vif-deleted-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:01 user nova-compute[72178]: WARNING nova.volume.cinder [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Attachment 3ec2caf7-de36-4bb8-ba8c-9e2b894a7c34 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3ec2caf7-de36-4bb8-ba8c-9e2b894a7c34. (HTTP 404) (Request-ID: req-24a4c9c9-b5a2-4f2a-88ff-fbed273504d5)
Aug 01 12:21:01 user nova-compute[72178]: INFO nova.compute.manager [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Took 0.03 seconds to detach 1 volumes for instance.
Aug 01 12:21:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:02 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Deleted allocations for instance 508f4bcf-bc5b-44d5-85d6-ab6b90693afb
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-d67629e2-915f-4558-9ceb-390c1f442773 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.424s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-38566812-ba2e-4b69-8e5a-c3946ad4f8e7 req-3bf8d793-90fd-4ff2-b61f-ed19b2dc9376 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received event network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-38566812-ba2e-4b69-8e5a-c3946ad4f8e7 req-3bf8d793-90fd-4ff2-b61f-ed19b2dc9376 service nova] Acquiring lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-38566812-ba2e-4b69-8e5a-c3946ad4f8e7 req-3bf8d793-90fd-4ff2-b61f-ed19b2dc9376 service nova] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-38566812-ba2e-4b69-8e5a-c3946ad4f8e7 req-3bf8d793-90fd-4ff2-b61f-ed19b2dc9376 service nova] Lock "508f4bcf-bc5b-44d5-85d6-ab6b90693afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.compute.manager [req-38566812-ba2e-4b69-8e5a-c3946ad4f8e7 req-3bf8d793-90fd-4ff2-b61f-ed19b2dc9376 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] No waiting events found dispatching network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:02 user nova-compute[72178]: WARNING nova.compute.manager [req-38566812-ba2e-4b69-8e5a-c3946ad4f8e7 req-3bf8d793-90fd-4ff2-b61f-ed19b2dc9376 service nova] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Received unexpected event network-vif-plugged-29c5428e-e0b4-4d19-825d-23eeb41dcec3 for instance with vm_state deleted and task_state None.
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.network.neutron [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Releasing lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:02 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance destroyed successfully.
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'resources' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:19:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG os_vif [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape15e122f-e6, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:02 user nova-compute[72178]: INFO os_vif [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6')
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Start _get_guest_xml network_info=[{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:02 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:02 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:19:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:21:02 user nova-compute[72178]:   <uuid>6c816328-61df-4625-95e6-bc27fbd7148d</uuid>
Aug 01 12:21:02 user nova-compute[72178]:   <name>instance-00000024</name>
Aug 01 12:21:02 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:21:02 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:21:02 user nova-compute[72178]:   <metadata>
Aug 01 12:21:02 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:21:02 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:21:02 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeTestJSON-server-1912286508</nova:name>
Aug 01 12:21:02 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:21:02</nova:creationTime>
Aug 01 12:21:02 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:21:02 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:21:02 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:21:02 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:21:02 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:21:02 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:21:02 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:21:02 user nova-compute[72178]:       <nova:owner>
Aug 01 12:21:02 user nova-compute[72178]:         <nova:user uuid="1158c8ff7efb465d9c7fdb7da7d22045">tempest-AttachVolumeTestJSON-236294761-project-member</nova:user>
Aug 01 12:21:02 user nova-compute[72178]:         <nova:project uuid="c5ca4acce2204173bad928ab3c58d053">tempest-AttachVolumeTestJSON-236294761</nova:project>
Aug 01 12:21:02 user nova-compute[72178]:       </nova:owner>
Aug 01 12:21:02 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:21:02 user nova-compute[72178]:       <nova:ports>
Aug 01 12:21:02 user nova-compute[72178]:         <nova:port uuid="e15e122f-e600-4d15-a508-998a84817013">
Aug 01 12:21:02 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 01 12:21:02 user nova-compute[72178]:         </nova:port>
Aug 01 12:21:02 user nova-compute[72178]:       </nova:ports>
Aug 01 12:21:02 user nova-compute[72178]:     </nova:instance>
Aug 01 12:21:02 user nova-compute[72178]:   </metadata>
Aug 01 12:21:02 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:21:02 user nova-compute[72178]:     <system>
Aug 01 12:21:02 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:21:02 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:21:02 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:21:02 user nova-compute[72178]:       <entry name="serial">6c816328-61df-4625-95e6-bc27fbd7148d</entry>
Aug 01 12:21:02 user nova-compute[72178]:       <entry name="uuid">6c816328-61df-4625-95e6-bc27fbd7148d</entry>
Aug 01 12:21:02 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:21:02 user nova-compute[72178]:     </system>
Aug 01 12:21:02 user nova-compute[72178]:   </sysinfo>
Aug 01 12:21:02 user nova-compute[72178]:   <os>
Aug 01 12:21:02 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:21:02 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:21:02 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:21:02 user nova-compute[72178]:   </os>
Aug 01 12:21:02 user nova-compute[72178]:   <features>
Aug 01 12:21:02 user nova-compute[72178]:     <acpi/>
Aug 01 12:21:02 user nova-compute[72178]:     <apic/>
Aug 01 12:21:02 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:21:02 user nova-compute[72178]:   </features>
Aug 01 12:21:02 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:21:02 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:21:02 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:21:02 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:21:02 user nova-compute[72178]:   </clock>
Aug 01 12:21:02 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:21:02 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:21:02 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:21:02 user nova-compute[72178]:   </cpu>
Aug 01 12:21:02 user nova-compute[72178]:   <devices>
Aug 01 12:21:02 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:21:02 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:21:02 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk"/>
Aug 01 12:21:02 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:21:02 user nova-compute[72178]:     </disk>
Aug 01 12:21:02 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:21:02 user nova-compute[72178]:       <mac address="fa:16:3e:de:3e:66"/>
Aug 01 12:21:02 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:21:02 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:21:02 user nova-compute[72178]:       <target dev="tape15e122f-e6"/>
Aug 01 12:21:02 user nova-compute[72178]:     </interface>
Aug 01 12:21:02 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:21:02 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/console.log" append="off"/>
Aug 01 12:21:02 user nova-compute[72178]:     </serial>
Aug 01 12:21:02 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:21:02 user nova-compute[72178]:     <video>
Aug 01 12:21:02 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:21:02 user nova-compute[72178]:     </video>
Aug 01 12:21:02 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:21:02 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:21:02 user nova-compute[72178]:     </rng>
Aug 01 12:21:02 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:21:02 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:21:02 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:21:02 user nova-compute[72178]:     </memballoon>
Aug 01 12:21:02 user nova-compute[72178]:   </devices>
Aug 01 12:21:02 user nova-compute[72178]: </domain>
Aug 01 12:21:02 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG nova.objects.instance [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:02 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Cannot resize image /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG nova.objects.instance [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'migration_context' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:19:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG os_vif [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape15e122f-e6, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape15e122f-e6, col_values=(('external_ids', {'iface-id': 'e15e122f-e600-4d15-a508-998a84817013', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:3e:66', 'vm-uuid': '6c816328-61df-4625-95e6-bc27fbd7148d'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:21:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:03 user nova-compute[72178]: INFO os_vif [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6')
Aug 01 12:21:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-3597f772-e431-4e06-90d1-3e078e3f639f req-ac194bb9-0291-44d3-a5da-3ba2c385808e service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3597f772-e431-4e06-90d1-3e078e3f639f req-ac194bb9-0291-44d3-a5da-3ba2c385808e service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3597f772-e431-4e06-90d1-3e078e3f639f req-ac194bb9-0291-44d3-a5da-3ba2c385808e service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:04 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3597f772-e431-4e06-90d1-3e078e3f639f req-ac194bb9-0291-44d3-a5da-3ba2c385808e service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:04 user nova-compute[72178]: DEBUG nova.compute.manager [req-3597f772-e431-4e06-90d1-3e078e3f639f req-ac194bb9-0291-44d3-a5da-3ba2c385808e service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:04 user nova-compute[72178]: WARNING nova.compute.manager [req-3597f772-e431-4e06-90d1-3e078e3f639f req-ac194bb9-0291-44d3-a5da-3ba2c385808e service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state stopped and task_state powering-on.
Aug 01 12:21:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892466.7074552, 6c816328-61df-4625-95e6-bc27fbd7148d => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:06 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Resumed (Lifecycle Event)
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:21:06 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance rebooted successfully.
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-eef21708-26c4-4790-b570-5e3a90d670a7 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:21:06 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892466.709136, 6c816328-61df-4625-95e6-bc27fbd7148d => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:06 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Started (Lifecycle Event)
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-30909aca-adb8-468e-98c8-7d8e17402500 req-20d5d6db-64fd-42ac-9c30-d285657057cd service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-30909aca-adb8-468e-98c8-7d8e17402500 req-20d5d6db-64fd-42ac-9c30-d285657057cd service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-30909aca-adb8-468e-98c8-7d8e17402500 req-20d5d6db-64fd-42ac-9c30-d285657057cd service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-30909aca-adb8-468e-98c8-7d8e17402500 req-20d5d6db-64fd-42ac-9c30-d285657057cd service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:06 user nova-compute[72178]: DEBUG nova.compute.manager [req-30909aca-adb8-468e-98c8-7d8e17402500 req-20d5d6db-64fd-42ac-9c30-d285657057cd service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:06 user nova-compute[72178]: WARNING nova.compute.manager [req-30909aca-adb8-468e-98c8-7d8e17402500 req-20d5d6db-64fd-42ac-9c30-d285657057cd service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state active and task_state None.
Aug 01 12:21:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:15 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892460.5657349, 508f4bcf-bc5b-44d5-85d6-ab6b90693afb => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:15 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] VM Stopped (Lifecycle Event)
Aug 01 12:21:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-60672ae7-5080-4df0-bbce-68dd1788aa36 None None] [instance: 508f4bcf-bc5b-44d5-85d6-ab6b90693afb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-3d2969d8-70da-448f-a906-84e684570cad req-13caeb3e-dff1-451b-a7d7-cb3b31e3678d service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received event network-changed-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-3d2969d8-70da-448f-a906-84e684570cad req-13caeb3e-dff1-451b-a7d7-cb3b31e3678d service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Refreshing instance network info cache due to event network-changed-7eacccce-d3b6-4750-9a19-2852f48b57e3. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:21:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d2969d8-70da-448f-a906-84e684570cad req-13caeb3e-dff1-451b-a7d7-cb3b31e3678d service nova] Acquiring lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d2969d8-70da-448f-a906-84e684570cad req-13caeb3e-dff1-451b-a7d7-cb3b31e3678d service nova] Acquired lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:15 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d2969d8-70da-448f-a906-84e684570cad req-13caeb3e-dff1-451b-a7d7-cb3b31e3678d service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Refreshing network info cache for port 7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG nova.objects.instance [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'flavor' on Instance uuid 53f00180-560e-486e-92a9-558bed951f36 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d2969d8-70da-448f-a906-84e684570cad req-13caeb3e-dff1-451b-a7d7-cb3b31e3678d service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updated VIF entry in instance network info cache for port 7eacccce-d3b6-4750-9a19-2852f48b57e3. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG nova.network.neutron [req-3d2969d8-70da-448f-a906-84e684570cad req-13caeb3e-dff1-451b-a7d7-cb3b31e3678d service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updating instance_info_cache with network_info: [{"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3d2969d8-70da-448f-a906-84e684570cad req-13caeb3e-dff1-451b-a7d7-cb3b31e3678d service nova] Releasing lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:16 user nova-compute[72178]: INFO nova.compute.manager [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Attaching volume c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 to /dev/vdb
Aug 01 12:21:16 user nova-compute[72178]: DEBUG os_brick.utils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9883967e-0adc-467e-80fc-02e741a5ad4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ede9af-b1c5-48a2-82d8-7a45c402e33b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe38e4a1-2373-453f-a843-0be5886c0c63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfd7eae-bac3-4895-b330-a1d9b1aaaf39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:21:16 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:21:16 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e274ff-4f3d-4d36-be3b-38a50e57cebd]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG os_brick.utils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:21:16 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updating existing volume attachment record: 0cc23000-e4b4-45a4-9907-6b2a993f4254 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:21:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:21:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:21:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:21:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:21:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:21:21 user nova-compute[72178]: INFO nova.compute.claims [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Claim successful on node user
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.network.neutron [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:21:21 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:21:21 user nova-compute[72178]: DEBUG nova.policy [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73fd81d3a10a4819a414d5a61a9d6056', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '874d88ce21b743e195c696aaa7195ffc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:21:22 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Creating image(s)
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "/opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "/opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.155s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk 1073741824" returned: 0 in 0.057s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG nova.network.neutron [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Successfully created port: f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Cannot resize image /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG nova.objects.instance [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'migration_context' on Instance uuid e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Ensure instance console log exists: /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:22 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.neutron [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Successfully updated port: f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquired lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.neutron [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.compute.manager [req-600d8e0f-ff02-42c1-bbab-f7a5bffe6cfc req-d363198f-74b4-4154-ad7f-e51f4a9cc263 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received event network-changed-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.compute.manager [req-600d8e0f-ff02-42c1-bbab-f7a5bffe6cfc req-d363198f-74b4-4154-ad7f-e51f4a9cc263 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Refreshing instance network info cache due to event network-changed-f1f6d4f4-e0a4-4122-a499-2b0022a12570. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-600d8e0f-ff02-42c1-bbab-f7a5bffe6cfc req-d363198f-74b4-4154-ad7f-e51f4a9cc263 service nova] Acquiring lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.neutron [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRTAwqkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:21:23 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:21:23 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:21:23 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d162ee12-f1cc-4a6b-b13c-4a410730d95e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:21:23 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cf9767-4c20-49be-8fbd-397aab785d85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6] added
Aug 01 12:21:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.neutron [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Updating instance_info_cache with network_info: [{"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9a51e-b7f3-4ed9-a8bb-5ae51a8b380c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Releasing lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Instance network_info: |[{"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-600d8e0f-ff02-42c1-bbab-f7a5bffe6cfc req-d363198f-74b4-4154-ad7f-e51f4a9cc263 service nova] Acquired lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.neutron [req-600d8e0f-ff02-42c1-bbab-f7a5bffe6cfc req-d363198f-74b4-4154-ad7f-e51f4a9cc263 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Refreshing network info cache for port f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Start _get_guest_xml network_info=[{"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[08712813-0a59-43bd-b778-41de7b0ab369]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRTAwqkX {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:23 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:23 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1932550499',display_name='tempest-AttachVolumeNegativeTest-server-1932550499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1932550499',id=45,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX2khq7ioCLoBPdaryyMFtx+v3sgADaQ485sQf+RUDSX49CKKph05FbVpWqL3SuA7NDQSLy3PAia5KD8aPoIAUde+igWI3qwqG7rb/2hyHBUdFOP4X2HR7y3G5HPfBaQw==',key_name='tempest-keypair-990035654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-smnlydcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:21:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1f6d4f4-e0a4-4122-a499-2b0022a12570,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f6d4f4-e0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.objects.instance [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'pci_devices' on Instance uuid e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRTAwqkX" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f1c4d1-2d6d-4a94-827c-dbdd478de700]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRTAwqkX'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:21:23 user nova-compute[72178]:   <uuid>e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb</uuid>
Aug 01 12:21:23 user nova-compute[72178]:   <name>instance-0000002d</name>
Aug 01 12:21:23 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:21:23 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:21:23 user nova-compute[72178]:   <metadata>
Aug 01 12:21:23 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:21:23 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:21:23 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1932550499</nova:name>
Aug 01 12:21:23 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:21:23</nova:creationTime>
Aug 01 12:21:23 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:21:23 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:21:23 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:21:23 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:21:23 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:21:23 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:21:23 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:21:23 user nova-compute[72178]:       <nova:owner>
Aug 01 12:21:23 user nova-compute[72178]:         <nova:user uuid="73fd81d3a10a4819a414d5a61a9d6056">tempest-AttachVolumeNegativeTest-1677263646-project-member</nova:user>
Aug 01 12:21:23 user nova-compute[72178]:         <nova:project uuid="874d88ce21b743e195c696aaa7195ffc">tempest-AttachVolumeNegativeTest-1677263646</nova:project>
Aug 01 12:21:23 user nova-compute[72178]:       </nova:owner>
Aug 01 12:21:23 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:21:23 user nova-compute[72178]:       <nova:ports>
Aug 01 12:21:23 user nova-compute[72178]:         <nova:port uuid="f1f6d4f4-e0a4-4122-a499-2b0022a12570">
Aug 01 12:21:23 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 01 12:21:23 user nova-compute[72178]:         </nova:port>
Aug 01 12:21:23 user nova-compute[72178]:       </nova:ports>
Aug 01 12:21:23 user nova-compute[72178]:     </nova:instance>
Aug 01 12:21:23 user nova-compute[72178]:   </metadata>
Aug 01 12:21:23 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:21:23 user nova-compute[72178]:     <system>
Aug 01 12:21:23 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:21:23 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:21:23 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:21:23 user nova-compute[72178]:       <entry name="serial">e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb</entry>
Aug 01 12:21:23 user nova-compute[72178]:       <entry name="uuid">e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb</entry>
Aug 01 12:21:23 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:21:23 user nova-compute[72178]:     </system>
Aug 01 12:21:23 user nova-compute[72178]:   </sysinfo>
Aug 01 12:21:23 user nova-compute[72178]:   <os>
Aug 01 12:21:23 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:21:23 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:21:23 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:21:23 user nova-compute[72178]:   </os>
Aug 01 12:21:23 user nova-compute[72178]:   <features>
Aug 01 12:21:23 user nova-compute[72178]:     <acpi/>
Aug 01 12:21:23 user nova-compute[72178]:     <apic/>
Aug 01 12:21:23 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:21:23 user nova-compute[72178]:   </features>
Aug 01 12:21:23 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:21:23 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:21:23 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:21:23 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:21:23 user nova-compute[72178]:   </clock>
Aug 01 12:21:23 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:21:23 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:21:23 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:21:23 user nova-compute[72178]:   </cpu>
Aug 01 12:21:23 user nova-compute[72178]:   <devices>
Aug 01 12:21:23 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:21:23 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:21:23 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk"/>
Aug 01 12:21:23 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:21:23 user nova-compute[72178]:     </disk>
Aug 01 12:21:23 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:21:23 user nova-compute[72178]:       <mac address="fa:16:3e:ed:94:bc"/>
Aug 01 12:21:23 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:21:23 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:21:23 user nova-compute[72178]:       <target dev="tapf1f6d4f4-e0"/>
Aug 01 12:21:23 user nova-compute[72178]:     </interface>
Aug 01 12:21:23 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:21:23 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/console.log" append="off"/>
Aug 01 12:21:23 user nova-compute[72178]:     </serial>
Aug 01 12:21:23 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:21:23 user nova-compute[72178]:     <video>
Aug 01 12:21:23 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:21:23 user nova-compute[72178]:     </video>
Aug 01 12:21:23 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:21:23 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:21:23 user nova-compute[72178]:     </rng>
Aug 01 12:21:23 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:21:23 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:21:23 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:21:23 user nova-compute[72178]:     </memballoon>
Aug 01 12:21:23 user nova-compute[72178]:   </devices>
Aug 01 12:21:23 user nova-compute[72178]: </domain>
Aug 01 12:21:23 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1932550499',display_name='tempest-AttachVolumeNegativeTest-server-1932550499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1932550499',id=45,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX2khq7ioCLoBPdaryyMFtx+v3sgADaQ485sQf+RUDSX49CKKph05FbVpWqL3SuA7NDQSLy3PAia5KD8aPoIAUde+igWI3qwqG7rb/2hyHBUdFOP4X2HR7y3G5HPfBaQw==',key_name='tempest-keypair-990035654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-smnlydcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:21:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1f6d4f4-e0a4-4122-a499-2b0022a12570,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f6d4f4-e0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_vif [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1f6d4f4-e0a4-4122-a499-2b0022a12570,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f6d4f4-e0') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a525a0f-26ad-48ac-8d15-5efa8fa8ea2f]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1f6d4f4-e0, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf1f6d4f4-e0, col_values=(('external_ids', {'iface-id': 'f1f6d4f4-e0a4-4122-a499-2b0022a12570', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:94:bc', 'vm-uuid': 'e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:23 user nova-compute[72178]: INFO os_vif [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:94:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1f6d4f4-e0a4-4122-a499-2b0022a12570,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f6d4f4-e0')
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32bf3a6-9997-43f5-944f-a9357e17cbfe]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f01502d-a0d2-4a68-9f7d-96dbd109f049]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6, portal: 172.16.0.220,3260]
Aug 01 12:21:23 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6, portal: 172.16.0.220,3260] successful.
Aug 01 12:21:23 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:23 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No VIF found with MAC fa:16:3e:ed:94:bc, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5427871d-0b79-4c23-a923-bcd08daef97c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba7c2a2-dd26-46f0-a23f-49c6684ffbd3]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:24 user nova-compute[72178]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 (non-flash)
Aug 01 12:21:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:24 user nova-compute[72178]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 (non-flash)
Aug 01 12:21:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45f3e25-14df-4a62-b612-1d4570eaaedb]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRTAwqkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG nova.network.neutron [req-600d8e0f-ff02-42c1-bbab-f7a5bffe6cfc req-d363198f-74b4-4154-ad7f-e51f4a9cc263 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Updated VIF entry in instance network info cache for port f1f6d4f4-e0a4-4122-a499-2b0022a12570. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG nova.network.neutron [req-600d8e0f-ff02-42c1-bbab-f7a5bffe6cfc req-d363198f-74b4-4154-ad7f-e51f4a9cc263 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Updating instance_info_cache with network_info: [{"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-600d8e0f-ff02-42c1-bbab-f7a5bffe6cfc req-d363198f-74b4-4154-ad7f-e51f4a9cc263 service nova] Releasing lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23664363134386139', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664363134386139', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG nova.objects.instance [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'flavor' on Instance uuid 53f00180-560e-486e-92a9-558bed951f36 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:21:25 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:21:25 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:21:25 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:21:25 user nova-compute[72178]:   <serial>c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6</serial>
Aug 01 12:21:25 user nova-compute[72178]: </disk>
Aug 01 12:21:25 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] No VIF found with MAC fa:16:3e:ce:f6:dd, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-66caba3f-44c2-4e17-b984-6aa2e9f4868e tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.477s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG nova.compute.manager [req-0285169b-809a-43d4-bc7c-887a7f964bd7 req-05cb1324-60e0-44fa-8765-0624f9e72d7e service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received event network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0285169b-809a-43d4-bc7c-887a7f964bd7 req-05cb1324-60e0-44fa-8765-0624f9e72d7e service nova] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0285169b-809a-43d4-bc7c-887a7f964bd7 req-05cb1324-60e0-44fa-8765-0624f9e72d7e service nova] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-0285169b-809a-43d4-bc7c-887a7f964bd7 req-05cb1324-60e0-44fa-8765-0624f9e72d7e service nova] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:25 user nova-compute[72178]: DEBUG nova.compute.manager [req-0285169b-809a-43d4-bc7c-887a7f964bd7 req-05cb1324-60e0-44fa-8765-0624f9e72d7e service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] No waiting events found dispatching network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:25 user nova-compute[72178]: WARNING nova.compute.manager [req-0285169b-809a-43d4-bc7c-887a7f964bd7 req-05cb1324-60e0-44fa-8765-0624f9e72d7e service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received unexpected event network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 for instance with vm_state building and task_state spawning.
Aug 01 12:21:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.compute.manager [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Detaching volume c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.virt.block_device [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Attempting to driver detach volume c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 from mountpoint /dev/vdb
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Attempting to detach device vdb from instance 53f00180-560e-486e-92a9-558bed951f36 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:21:27 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:21:27 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:21:27 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:21:27 user nova-compute[72178]:   <serial>c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6</serial>
Aug 01 12:21:27 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:21:27 user nova-compute[72178]: </disk>
Aug 01 12:21:27 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Successfully detached device vdb from instance 53f00180-560e-486e-92a9-558bed951f36 from the persistent domain config.
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 53f00180-560e-486e-92a9-558bed951f36 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:21:27 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:21:27 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:21:27 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:21:27 user nova-compute[72178]:   <serial>c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6</serial>
Aug 01 12:21:27 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:21:27 user nova-compute[72178]: </disk>
Aug 01 12:21:27 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Instance spawned successfully.
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892487.8091795, e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] VM Resumed (Lifecycle Event)
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892487.8096397, e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] VM Started (Lifecycle Event)
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:21:27 user nova-compute[72178]: INFO nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-14badea7-8143-4b9f-9928-19007f7bf811 req-0c8a0bd0-4a37-48bc-ab0e-c0bc7717cc71 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received event network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-14badea7-8143-4b9f-9928-19007f7bf811 req-0c8a0bd0-4a37-48bc-ab0e-c0bc7717cc71 service nova] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-14badea7-8143-4b9f-9928-19007f7bf811 req-0c8a0bd0-4a37-48bc-ab0e-c0bc7717cc71 service nova] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-14badea7-8143-4b9f-9928-19007f7bf811 req-0c8a0bd0-4a37-48bc-ab0e-c0bc7717cc71 service nova] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:27 user nova-compute[72178]: DEBUG nova.compute.manager [req-14badea7-8143-4b9f-9928-19007f7bf811 req-0c8a0bd0-4a37-48bc-ab0e-c0bc7717cc71 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] No waiting events found dispatching network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:27 user nova-compute[72178]: WARNING nova.compute.manager [req-14badea7-8143-4b9f-9928-19007f7bf811 req-0c8a0bd0-4a37-48bc-ab0e-c0bc7717cc71 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received unexpected event network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 for instance with vm_state building and task_state spawning.
Aug 01 12:21:28 user nova-compute[72178]: INFO nova.compute.manager [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Took 6.59 seconds to build instance.
Aug 01 12:21:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892488.0503726, 53f00180-560e-486e-92a9-558bed951f36 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-175148a0-0c55-4ceb-b87c-b3efba793386 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.685s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 53f00180-560e-486e-92a9-558bed951f36 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:21:28 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Successfully detached device vdb from instance 53f00180-560e-486e-92a9-558bed951f36 from the live domain config.
Aug 01 12:21:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRTAwqkX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:21:28 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b29d6c-af5b-4ff9-9352-a09a1fd2b140]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[997a5d7e-e5b1-4e5f-b32e-6d4728fd083f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:28 user nova-compute[72178]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 (non-flash)
Aug 01 12:21:28 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:28 user nova-compute[72178]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 (non-flash)
Aug 01 12:21:28 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9017bc310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeac0fd-cf4a-4ded-b1b8-c7889924b416]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b676a14-4544-4e84-858c-ae65cf317d75]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[75839cdb-5b46-4cc7-a078-1c405f3116f7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bea5edc-16af-434a-8404-40cd5bb6733e]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2770341d-442e-424c-a87f-2a4b38eb03c0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9c59e-7127-4b9d-a2eb-6c7495f7dea4]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6, portal: 172.16.0.220,3260]
Aug 01 12:21:28 user nova-compute[72178]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6, portal: 172.16.0.220,3260] successful.
Aug 01 12:21:28 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c779d8bb-349d-4eb7-a376-9ee1d9ee5ad6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb85a2f4-96d1-42ca-946d-8bf7ad867e91]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] <== disconnect_volume: return (256ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:29 user nova-compute[72178]: DEBUG nova.objects.instance [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'flavor' on Instance uuid 53f00180-560e-486e-92a9-558bed951f36 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1083d382-7132-42b6-9d0b-4ed999dfccf0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.678s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:32 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG nova.compute.manager [req-677428ef-392a-4216-80fe-bbb3026043a1 req-3cc7544c-b709-4510-a980-b097de5bd975 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-changed-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG nova.compute.manager [req-677428ef-392a-4216-80fe-bbb3026043a1 req-3cc7544c-b709-4510-a980-b097de5bd975 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Refreshing instance network info cache due to event network-changed-156e216e-1d49-4a3f-bbc3-a9255430cc36. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-677428ef-392a-4216-80fe-bbb3026043a1 req-3cc7544c-b709-4510-a980-b097de5bd975 service nova] Acquiring lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-677428ef-392a-4216-80fe-bbb3026043a1 req-3cc7544c-b709-4510-a980-b097de5bd975 service nova] Acquired lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG nova.network.neutron [req-677428ef-392a-4216-80fe-bbb3026043a1 req-3cc7544c-b709-4510-a980-b097de5bd975 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Refreshing network info cache for port 156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "cb59098f-6c2f-4f58-9e83-a3898328625b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:21:34 user nova-compute[72178]: INFO nova.compute.claims [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Claim successful on node user
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.network.neutron [req-677428ef-392a-4216-80fe-bbb3026043a1 req-3cc7544c-b709-4510-a980-b097de5bd975 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updated VIF entry in instance network info cache for port 156e216e-1d49-4a3f-bbc3-a9255430cc36. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.network.neutron [req-677428ef-392a-4216-80fe-bbb3026043a1 req-3cc7544c-b709-4510-a980-b097de5bd975 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updating instance_info_cache with network_info: [{"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-677428ef-392a-4216-80fe-bbb3026043a1 req-3cc7544c-b709-4510-a980-b097de5bd975 service nova] Releasing lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:21:34 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.policy [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '923afe9bd6654c02b9a2dc0d2c7aacd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5744024985c24187a2add045778a28df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:21:34 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Creating image(s)
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "/opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "/opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk 1073741824" returned: 0 in 0.058s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:34 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Cannot resize image /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lazy-loading 'migration_context' on Instance uuid cb59098f-6c2f-4f58-9e83-a3898328625b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Ensure instance console log exists: /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:35 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Successfully created port: b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Successfully updated port: b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "refresh_cache-cb59098f-6c2f-4f58-9e83-a3898328625b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquired lock "refresh_cache-cb59098f-6c2f-4f58-9e83-a3898328625b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-4395f783-f509-4a68-b168-e31fbe7716f2 req-5337e4b6-388f-4f59-a764-3d8c828e1b74 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received event network-changed-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-4395f783-f509-4a68-b168-e31fbe7716f2 req-5337e4b6-388f-4f59-a764-3d8c828e1b74 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Refreshing instance network info cache due to event network-changed-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4395f783-f509-4a68-b168-e31fbe7716f2 req-5337e4b6-388f-4f59-a764-3d8c828e1b74 service nova] Acquiring lock "refresh_cache-cb59098f-6c2f-4f58-9e83-a3898328625b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Updating instance_info_cache with network_info: [{"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Releasing lock "refresh_cache-cb59098f-6c2f-4f58-9e83-a3898328625b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Instance network_info: |[{"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4395f783-f509-4a68-b168-e31fbe7716f2 req-5337e4b6-388f-4f59-a764-3d8c828e1b74 service nova] Acquired lock "refresh_cache-cb59098f-6c2f-4f58-9e83-a3898328625b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-4395f783-f509-4a68-b168-e31fbe7716f2 req-5337e4b6-388f-4f59-a764-3d8c828e1b74 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Refreshing network info cache for port b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Start _get_guest_xml network_info=[{"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:21:36 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:36 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1207429464',display_name='tempest-ServersNegativeTestJSON-server-1207429464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1207429464',id=46,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5744024985c24187a2add045778a28df',ramdisk_id='',reservation_id='r-rokh8750',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1559526557',owner_user_name='tempest-ServersNegativeTestJSON-1559526557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:21:35Z,user_data=None,user_id='923afe9bd6654c02b9a2dc0d2c7aacd9',uuid=cb59098f-6c2f-4f58-9e83-a3898328625b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converting VIF {"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:53:23,bridge_name='br-int',has_traffic_filtering=True,id=b0965ecb-4ff6-4e61-b813-e4809ffc3d2e,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0965ecb-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lazy-loading 'pci_devices' on Instance uuid cb59098f-6c2f-4f58-9e83-a3898328625b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:21:36 user nova-compute[72178]:   <uuid>cb59098f-6c2f-4f58-9e83-a3898328625b</uuid>
Aug 01 12:21:36 user nova-compute[72178]:   <name>instance-0000002e</name>
Aug 01 12:21:36 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:21:36 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:21:36 user nova-compute[72178]:   <metadata>
Aug 01 12:21:36 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:21:36 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:21:36 user nova-compute[72178]:       <nova:name>tempest-ServersNegativeTestJSON-server-1207429464</nova:name>
Aug 01 12:21:36 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:21:36</nova:creationTime>
Aug 01 12:21:36 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:21:36 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:21:36 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:21:36 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:21:36 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:21:36 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:21:36 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:21:36 user nova-compute[72178]:       <nova:owner>
Aug 01 12:21:36 user nova-compute[72178]:         <nova:user uuid="923afe9bd6654c02b9a2dc0d2c7aacd9">tempest-ServersNegativeTestJSON-1559526557-project-member</nova:user>
Aug 01 12:21:36 user nova-compute[72178]:         <nova:project uuid="5744024985c24187a2add045778a28df">tempest-ServersNegativeTestJSON-1559526557</nova:project>
Aug 01 12:21:36 user nova-compute[72178]:       </nova:owner>
Aug 01 12:21:36 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:21:36 user nova-compute[72178]:       <nova:ports>
Aug 01 12:21:36 user nova-compute[72178]:         <nova:port uuid="b0965ecb-4ff6-4e61-b813-e4809ffc3d2e">
Aug 01 12:21:36 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 12:21:36 user nova-compute[72178]:         </nova:port>
Aug 01 12:21:36 user nova-compute[72178]:       </nova:ports>
Aug 01 12:21:36 user nova-compute[72178]:     </nova:instance>
Aug 01 12:21:36 user nova-compute[72178]:   </metadata>
Aug 01 12:21:36 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:21:36 user nova-compute[72178]:     <system>
Aug 01 12:21:36 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:21:36 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:21:36 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:21:36 user nova-compute[72178]:       <entry name="serial">cb59098f-6c2f-4f58-9e83-a3898328625b</entry>
Aug 01 12:21:36 user nova-compute[72178]:       <entry name="uuid">cb59098f-6c2f-4f58-9e83-a3898328625b</entry>
Aug 01 12:21:36 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:21:36 user nova-compute[72178]:     </system>
Aug 01 12:21:36 user nova-compute[72178]:   </sysinfo>
Aug 01 12:21:36 user nova-compute[72178]:   <os>
Aug 01 12:21:36 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:21:36 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:21:36 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:21:36 user nova-compute[72178]:   </os>
Aug 01 12:21:36 user nova-compute[72178]:   <features>
Aug 01 12:21:36 user nova-compute[72178]:     <acpi/>
Aug 01 12:21:36 user nova-compute[72178]:     <apic/>
Aug 01 12:21:36 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:21:36 user nova-compute[72178]:   </features>
Aug 01 12:21:36 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:21:36 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:21:36 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:21:36 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:21:36 user nova-compute[72178]:   </clock>
Aug 01 12:21:36 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:21:36 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:21:36 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:21:36 user nova-compute[72178]:   </cpu>
Aug 01 12:21:36 user nova-compute[72178]:   <devices>
Aug 01 12:21:36 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:21:36 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:21:36 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk"/>
Aug 01 12:21:36 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:21:36 user nova-compute[72178]:     </disk>
Aug 01 12:21:36 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:21:36 user nova-compute[72178]:       <mac address="fa:16:3e:56:53:23"/>
Aug 01 12:21:36 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:21:36 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:21:36 user nova-compute[72178]:       <target dev="tapb0965ecb-4f"/>
Aug 01 12:21:36 user nova-compute[72178]:     </interface>
Aug 01 12:21:36 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:21:36 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/console.log" append="off"/>
Aug 01 12:21:36 user nova-compute[72178]:     </serial>
Aug 01 12:21:36 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:21:36 user nova-compute[72178]:     <video>
Aug 01 12:21:36 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:21:36 user nova-compute[72178]:     </video>
Aug 01 12:21:36 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:21:36 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:21:36 user nova-compute[72178]:     </rng>
Aug 01 12:21:36 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:21:36 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:21:36 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:21:36 user nova-compute[72178]:     </memballoon>
Aug 01 12:21:36 user nova-compute[72178]:   </devices>
Aug 01 12:21:36 user nova-compute[72178]: </domain>
Aug 01 12:21:36 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1207429464',display_name='tempest-ServersNegativeTestJSON-server-1207429464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1207429464',id=46,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5744024985c24187a2add045778a28df',ramdisk_id='',reservation_id='r-rokh8750',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1559526557',owner_user_name='tempest-ServersNegativeTestJSON-1559526557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:21:35Z,user_data=None,user_id='923afe9bd6654c02b9a2dc0d2c7aacd9',uuid=cb59098f-6c2f-4f58-9e83-a3898328625b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converting VIF {"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:53:23,bridge_name='br-int',has_traffic_filtering=True,id=b0965ecb-4ff6-4e61-b813-e4809ffc3d2e,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0965ecb-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG os_vif [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:53:23,bridge_name='br-int',has_traffic_filtering=True,id=b0965ecb-4ff6-4e61-b813-e4809ffc3d2e,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0965ecb-4f') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0965ecb-4f, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0965ecb-4f, col_values=(('external_ids', {'iface-id': 'b0965ecb-4ff6-4e61-b813-e4809ffc3d2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:53:23', 'vm-uuid': 'cb59098f-6c2f-4f58-9e83-a3898328625b'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:36 user nova-compute[72178]: INFO os_vif [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:53:23,bridge_name='br-int',has_traffic_filtering=True,id=b0965ecb-4ff6-4e61-b813-e4809ffc3d2e,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0965ecb-4f')
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:21:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] No VIF found with MAC fa:16:3e:56:53:23, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:21:37 user nova-compute[72178]: DEBUG nova.network.neutron [req-4395f783-f509-4a68-b168-e31fbe7716f2 req-5337e4b6-388f-4f59-a764-3d8c828e1b74 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Updated VIF entry in instance network info cache for port b0965ecb-4ff6-4e61-b813-e4809ffc3d2e. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:21:37 user nova-compute[72178]: DEBUG nova.network.neutron [req-4395f783-f509-4a68-b168-e31fbe7716f2 req-5337e4b6-388f-4f59-a764-3d8c828e1b74 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Updating instance_info_cache with network_info: [{"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4395f783-f509-4a68-b168-e31fbe7716f2 req-5337e4b6-388f-4f59-a764-3d8c828e1b74 service nova] Releasing lock "refresh_cache-cb59098f-6c2f-4f58-9e83-a3898328625b" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-fbaed922-e9d8-4224-b996-ae1ee1918ff0 req-b5906e6a-323c-407e-836e-707c06e70e67 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received event network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fbaed922-e9d8-4224-b996-ae1ee1918ff0 req-b5906e6a-323c-407e-836e-707c06e70e67 service nova] Acquiring lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fbaed922-e9d8-4224-b996-ae1ee1918ff0 req-b5906e6a-323c-407e-836e-707c06e70e67 service nova] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-fbaed922-e9d8-4224-b996-ae1ee1918ff0 req-b5906e6a-323c-407e-836e-707c06e70e67 service nova] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-fbaed922-e9d8-4224-b996-ae1ee1918ff0 req-b5906e6a-323c-407e-836e-707c06e70e67 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] No waiting events found dispatching network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:38 user nova-compute[72178]: WARNING nova.compute.manager [req-fbaed922-e9d8-4224-b996-ae1ee1918ff0 req-b5906e6a-323c-407e-836e-707c06e70e67 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received unexpected event network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e for instance with vm_state building and task_state spawning.
Aug 01 12:21:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892500.3257332, cb59098f-6c2f-4f58-9e83-a3898328625b => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] VM Resumed (Lifecycle Event)
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:21:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Instance spawned successfully.
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892500.3300457, cb59098f-6c2f-4f58-9e83-a3898328625b => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] VM Started (Lifecycle Event)
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:21:40 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:21:40 user nova-compute[72178]: INFO nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-eed3937b-e19d-4f5e-8fc5-ee7bc379ba6e req-cb75d3a2-b5f4-47d0-87aa-49f3f56a6a7d service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received event network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eed3937b-e19d-4f5e-8fc5-ee7bc379ba6e req-cb75d3a2-b5f4-47d0-87aa-49f3f56a6a7d service nova] Acquiring lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eed3937b-e19d-4f5e-8fc5-ee7bc379ba6e req-cb75d3a2-b5f4-47d0-87aa-49f3f56a6a7d service nova] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-eed3937b-e19d-4f5e-8fc5-ee7bc379ba6e req-cb75d3a2-b5f4-47d0-87aa-49f3f56a6a7d service nova] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-eed3937b-e19d-4f5e-8fc5-ee7bc379ba6e req-cb75d3a2-b5f4-47d0-87aa-49f3f56a6a7d service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] No waiting events found dispatching network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:40 user nova-compute[72178]: WARNING nova.compute.manager [req-eed3937b-e19d-4f5e-8fc5-ee7bc379ba6e req-cb75d3a2-b5f4-47d0-87aa-49f3f56a6a7d service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received unexpected event network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e for instance with vm_state building and task_state spawning.
Aug 01 12:21:40 user nova-compute[72178]: INFO nova.compute.manager [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Took 6.58 seconds to build instance.
Aug 01 12:21:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9c4eea80-1ebe-4401-a860-800d98dfd21d tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.690s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:21:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:21:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updating instance_info_cache with network_info: [{"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:21:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:21:44 user nova-compute[72178]: INFO nova.compute.claims [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Claim successful on node user
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:21:44 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:21:44 user nova-compute[72178]: INFO nova.virt.block_device [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Booting with volume d7d4bf67-d308-4f11-a840-fb79985677f8 at /dev/vda
Aug 01 12:21:44 user nova-compute[72178]: DEBUG nova.policy [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef22394fbdfd4aad8c301596a2ee7b61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e0eb9e0006c46dabba55cc95cca217f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG os_brick.utils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0747bff1-a27b-42a8-bb13-ad6148cd5db9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:44 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6147814-6157-44e2-b072-bf6c28e66a46]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b05525-6b6b-45c6-9082-3748f1f39b53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b7d4ee-f868-4feb-a283-478760ad42d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:21:45 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a281aca-8656-4c3c-9101-20042c1fe99f]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG os_brick.utils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updating existing volume attachment record: 8fc9a3b4-4883-4f8b-bdfd-c0fc95b738ee {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:21:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Successfully created port: ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Successfully updated port: ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquired lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-4eecdea8-2772-405c-b12d-30215bc4046d req-e80ba0af-2c82-420c-a893-9c92db0c9483 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-changed-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG nova.compute.manager [req-4eecdea8-2772-405c-b12d-30215bc4046d req-e80ba0af-2c82-420c-a893-9c92db0c9483 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Refreshing instance network info cache due to event network-changed-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4eecdea8-2772-405c-b12d-30215bc4046d req-e80ba0af-2c82-420c-a893-9c92db0c9483 service nova] Acquiring lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updating instance_info_cache with network_info: [{"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Releasing lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Instance network_info: |[{"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4eecdea8-2772-405c-b12d-30215bc4046d req-e80ba0af-2c82-420c-a893-9c92db0c9483 service nova] Acquired lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG nova.network.neutron [req-4eecdea8-2772-405c-b12d-30215bc4046d req-e80ba0af-2c82-420c-a893-9c92db0c9483 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Refreshing network info cache for port ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:21:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:47 user nova-compute[72178]: DEBUG nova.network.neutron [req-4eecdea8-2772-405c-b12d-30215bc4046d req-e80ba0af-2c82-420c-a893-9c92db0c9483 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updated VIF entry in instance network info cache for port ff8cbb1b-85e4-406f-aa5f-2efda9e4671f. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:21:47 user nova-compute[72178]: DEBUG nova.network.neutron [req-4eecdea8-2772-405c-b12d-30215bc4046d req-e80ba0af-2c82-420c-a893-9c92db0c9483 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updating instance_info_cache with network_info: [{"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:21:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4eecdea8-2772-405c-b12d-30215bc4046d req-e80ba0af-2c82-420c-a893-9c92db0c9483 service nova] Releasing lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:21:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:50 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:50 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=25.096420288085938GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:21:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 53f00180-560e-486e-92a9-558bed951f36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 051b1b49-f5b2-400d-ac88-b841439743ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance cb59098f-6c2f-4f58-9e83-a3898328625b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance de5dede0-6d6c-489d-8ce0-cd8fcd51f20c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:21:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Creating image(s)
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Did not create local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Ensure instance console log exists: /opt/stack/data/nova/instances/de5dede0-6d6c-489d-8ce0-cd8fcd51f20c/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Start _get_guest_xml network_info=[{"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVoybLwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de5dede0-6d6c-489d-8ce0-cd8fcd51f20c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7d4bf67-d308-4f11-a840-fb79985677f8', 'serial': 'd7d4bf67-d308-4f11-a840-fb79985677f8'}, 'boot_index': 0, 'attachment_id': '8fc9a3b4-4883-4f8b-bdfd-c0fc95b738ee', 'delete_on_termination': False, 'device_type': 'disk', 'volume_type': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:21:52 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:52 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVoybLwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:21:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:21:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:21:52 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c635b0-f6bb-4a7e-9fd7-0a294c76f836]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:21:52 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[092929ed-a4cf-4631-a52b-20c5abf01e59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8] added
Aug 01 12:21:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b20adec-5d67-4745-af95-803456355243]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[01670c2c-a8c3-479c-8547-925023e8ea7e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZVoybLwI {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZVoybLwI" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc4499c-6308-43b4-8b2f-adb43a27aa87]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZVoybLwI'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[74472610-4a2f-43d4-9b18-38d34dba89b5]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a794b8c-0a29-4cfb-ba39-646e80d2aa63]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[25054b27-a498-4732-9b33-ef86524294b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8, portal: 172.16.0.220,3260]
Aug 01 12:21:52 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8, portal: 172.16.0.220,3260] successful.
Aug 01 12:21:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed71d61c-dc34-4d2a-8e32-3009044b01e2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fea257-cf3f-432e-b3a4-d93de65affbe]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:52 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:21:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:21:52 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:21:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:21:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:21:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:21:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b233bb3-afaa-4792-a8bf-0df5882521d3]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:21:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:21:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVoybLwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:21:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:21:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23933633465366331', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933633465366331', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1225997741',display_name='tempest-TestVolumeBootPattern-server-1225997741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1225997741',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-0aagkhen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:21:45Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=de5dede0-6d6c-489d-8ce0-cd8fcd51f20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:78:18,bridge_name='br-int',has_traffic_filtering=True,id=ff8cbb1b-85e4-406f-aa5f-2efda9e4671f,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8cbb1b-85') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'pci_devices' on Instance uuid de5dede0-6d6c-489d-8ce0-cd8fcd51f20c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:21:54 user nova-compute[72178]:   <uuid>de5dede0-6d6c-489d-8ce0-cd8fcd51f20c</uuid>
Aug 01 12:21:54 user nova-compute[72178]:   <name>instance-0000002f</name>
Aug 01 12:21:54 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:21:54 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:21:54 user nova-compute[72178]:   <metadata>
Aug 01 12:21:54 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:21:54 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:21:54 user nova-compute[72178]:       <nova:name>tempest-TestVolumeBootPattern-server-1225997741</nova:name>
Aug 01 12:21:54 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:21:52</nova:creationTime>
Aug 01 12:21:54 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:21:54 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:21:54 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:21:54 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:21:54 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:21:54 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:21:54 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:21:54 user nova-compute[72178]:       <nova:owner>
Aug 01 12:21:54 user nova-compute[72178]:         <nova:user uuid="ef22394fbdfd4aad8c301596a2ee7b61">tempest-TestVolumeBootPattern-1003407750-project-member</nova:user>
Aug 01 12:21:54 user nova-compute[72178]:         <nova:project uuid="1e0eb9e0006c46dabba55cc95cca217f">tempest-TestVolumeBootPattern-1003407750</nova:project>
Aug 01 12:21:54 user nova-compute[72178]:       </nova:owner>
Aug 01 12:21:54 user nova-compute[72178]:       <nova:ports>
Aug 01 12:21:54 user nova-compute[72178]:         <nova:port uuid="ff8cbb1b-85e4-406f-aa5f-2efda9e4671f">
Aug 01 12:21:54 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 01 12:21:54 user nova-compute[72178]:         </nova:port>
Aug 01 12:21:54 user nova-compute[72178]:       </nova:ports>
Aug 01 12:21:54 user nova-compute[72178]:     </nova:instance>
Aug 01 12:21:54 user nova-compute[72178]:   </metadata>
Aug 01 12:21:54 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:21:54 user nova-compute[72178]:     <system>
Aug 01 12:21:54 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:21:54 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:21:54 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:21:54 user nova-compute[72178]:       <entry name="serial">de5dede0-6d6c-489d-8ce0-cd8fcd51f20c</entry>
Aug 01 12:21:54 user nova-compute[72178]:       <entry name="uuid">de5dede0-6d6c-489d-8ce0-cd8fcd51f20c</entry>
Aug 01 12:21:54 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:21:54 user nova-compute[72178]:     </system>
Aug 01 12:21:54 user nova-compute[72178]:   </sysinfo>
Aug 01 12:21:54 user nova-compute[72178]:   <os>
Aug 01 12:21:54 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:21:54 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:21:54 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:21:54 user nova-compute[72178]:   </os>
Aug 01 12:21:54 user nova-compute[72178]:   <features>
Aug 01 12:21:54 user nova-compute[72178]:     <acpi/>
Aug 01 12:21:54 user nova-compute[72178]:     <apic/>
Aug 01 12:21:54 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:21:54 user nova-compute[72178]:   </features>
Aug 01 12:21:54 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:21:54 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:21:54 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:21:54 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:21:54 user nova-compute[72178]:   </clock>
Aug 01 12:21:54 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:21:54 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:21:54 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:21:54 user nova-compute[72178]:   </cpu>
Aug 01 12:21:54 user nova-compute[72178]:   <devices>
Aug 01 12:21:54 user nova-compute[72178]:     <disk type="block" device="disk">
Aug 01 12:21:54 user nova-compute[72178]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:21:54 user nova-compute[72178]:       <source dev="/dev/sdc"/>
Aug 01 12:21:54 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:21:54 user nova-compute[72178]:       <serial>d7d4bf67-d308-4f11-a840-fb79985677f8</serial>
Aug 01 12:21:54 user nova-compute[72178]:     </disk>
Aug 01 12:21:54 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:21:54 user nova-compute[72178]:       <mac address="fa:16:3e:99:78:18"/>
Aug 01 12:21:54 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:21:54 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:21:54 user nova-compute[72178]:       <target dev="tapff8cbb1b-85"/>
Aug 01 12:21:54 user nova-compute[72178]:     </interface>
Aug 01 12:21:54 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:21:54 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/de5dede0-6d6c-489d-8ce0-cd8fcd51f20c/console.log" append="off"/>
Aug 01 12:21:54 user nova-compute[72178]:     </serial>
Aug 01 12:21:54 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:21:54 user nova-compute[72178]:     <video>
Aug 01 12:21:54 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:21:54 user nova-compute[72178]:     </video>
Aug 01 12:21:54 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:21:54 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:21:54 user nova-compute[72178]:     </rng>
Aug 01 12:21:54 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:21:54 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:21:54 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:21:54 user nova-compute[72178]:     </memballoon>
Aug 01 12:21:54 user nova-compute[72178]:   </devices>
Aug 01 12:21:54 user nova-compute[72178]: </domain>
Aug 01 12:21:54 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1225997741',display_name='tempest-TestVolumeBootPattern-server-1225997741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1225997741',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-0aagkhen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:21:45Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=de5dede0-6d6c-489d-8ce0-cd8fcd51f20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:78:18,bridge_name='br-int',has_traffic_filtering=True,id=ff8cbb1b-85e4-406f-aa5f-2efda9e4671f,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8cbb1b-85') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG os_vif [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:78:18,bridge_name='br-int',has_traffic_filtering=True,id=ff8cbb1b-85e4-406f-aa5f-2efda9e4671f,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8cbb1b-85') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff8cbb1b-85, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff8cbb1b-85, col_values=(('external_ids', {'iface-id': 'ff8cbb1b-85e4-406f-aa5f-2efda9e4671f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:78:18', 'vm-uuid': 'de5dede0-6d6c-489d-8ce0-cd8fcd51f20c'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:54 user nova-compute[72178]: INFO os_vif [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:78:18,bridge_name='br-int',has_traffic_filtering=True,id=ff8cbb1b-85e4-406f-aa5f-2efda9e4671f,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8cbb1b-85')
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:21:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] No VIF found with MAC fa:16:3e:99:78:18, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-e7459f06-4e40-4456-a1bf-2f36c554f29d req-c97a2a4f-6081-42be-b369-8c2bd343f0bf service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e7459f06-4e40-4456-a1bf-2f36c554f29d req-c97a2a4f-6081-42be-b369-8c2bd343f0bf service nova] Acquiring lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e7459f06-4e40-4456-a1bf-2f36c554f29d req-c97a2a4f-6081-42be-b369-8c2bd343f0bf service nova] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e7459f06-4e40-4456-a1bf-2f36c554f29d req-c97a2a4f-6081-42be-b369-8c2bd343f0bf service nova] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-e7459f06-4e40-4456-a1bf-2f36c554f29d req-c97a2a4f-6081-42be-b369-8c2bd343f0bf service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] No waiting events found dispatching network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:55 user nova-compute[72178]: WARNING nova.compute.manager [req-e7459f06-4e40-4456-a1bf-2f36c554f29d req-c97a2a4f-6081-42be-b369-8c2bd343f0bf service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received unexpected event network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f for instance with vm_state building and task_state spawning.
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892517.5362124, de5dede0-6d6c-489d-8ce0-cd8fcd51f20c => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] VM Resumed (Lifecycle Event)
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:21:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Instance spawned successfully.
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:21:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892517.5374653, de5dede0-6d6c-489d-8ce0-cd8fcd51f20c => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:21:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] VM Started (Lifecycle Event)
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:21:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:21:57 user nova-compute[72178]: INFO nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Took 5.03 seconds to spawn the instance on the hypervisor.
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:21:57 user nova-compute[72178]: INFO nova.compute.manager [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Took 13.48 seconds to build instance.
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-717c643b-d94c-490f-af73-44956c5d66ef req-fc989a44-8553-4a62-8f67-a63af831e176 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-717c643b-d94c-490f-af73-44956c5d66ef req-fc989a44-8553-4a62-8f67-a63af831e176 service nova] Acquiring lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-717c643b-d94c-490f-af73-44956c5d66ef req-fc989a44-8553-4a62-8f67-a63af831e176 service nova] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-717c643b-d94c-490f-af73-44956c5d66ef req-fc989a44-8553-4a62-8f67-a63af831e176 service nova] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-717c643b-d94c-490f-af73-44956c5d66ef req-fc989a44-8553-4a62-8f67-a63af831e176 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] No waiting events found dispatching network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:21:57 user nova-compute[72178]: WARNING nova.compute.manager [req-717c643b-d94c-490f-af73-44956c5d66ef req-fc989a44-8553-4a62-8f67-a63af831e176 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received unexpected event network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f for instance with vm_state active and task_state None.
Aug 01 12:21:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-aae32d18-82d8-430b-a942-7f2bb61249c5 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.574s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:21:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:21:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:22:09 user nova-compute[72178]: INFO nova.compute.claims [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Claim successful on node user
Aug 01 12:22:09 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:22:09 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:22:09 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:22:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.policy [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '517883471ec747278f78d0329efcccf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3e2397edfe04144b7eaea8d06ceb971', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:22:10 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Creating image(s)
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "/opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "/opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "/opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.142s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk 1073741824" returned: 0 in 0.057s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Successfully created port: ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Cannot resize image /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'migration_context' on Instance uuid 2571d92c-f0c2-4cff-b715-7610cc251145 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Ensure instance console log exists: /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Successfully updated port: ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquired lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-bbec7edf-1d0c-4be3-a83b-cc40a7ccb94f req-365b12c9-4aeb-4114-b9c9-99a923075236 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received event network-changed-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.compute.manager [req-bbec7edf-1d0c-4be3-a83b-cc40a7ccb94f req-365b12c9-4aeb-4114-b9c9-99a923075236 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Refreshing instance network info cache due to event network-changed-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbec7edf-1d0c-4be3-a83b-cc40a7ccb94f req-365b12c9-4aeb-4114-b9c9-99a923075236 service nova] Acquiring lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.neutron [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Updating instance_info_cache with network_info: [{"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Releasing lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Instance network_info: |[{"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbec7edf-1d0c-4be3-a83b-cc40a7ccb94f req-365b12c9-4aeb-4114-b9c9-99a923075236 service nova] Acquired lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.neutron [req-bbec7edf-1d0c-4be3-a83b-cc40a7ccb94f req-365b12c9-4aeb-4114-b9c9-99a923075236 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Refreshing network info cache for port ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Start _get_guest_xml network_info=[{"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:22:11 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:22:11 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-714379269',display_name='tempest-VolumesSnapshotTestJSON-instance-714379269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-714379269',id=48,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++WmGi2brBWHrIOiLTcBOYOxQawHhInI5h58T+PwvGjOTq7FTX/u1TEBEE/FdOaylnRjknSvLldKVyuRz0yCGGcXIQSLAUtIvYyF+DlErw/UcS2Q7z/nTad4x0cf5c5Q==',key_name='tempest-keypair-1921959805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3e2397edfe04144b7eaea8d06ceb971',ramdisk_id='',reservation_id='r-ot5kqy04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1949254885',owner_user_name='tempest-VolumesSnapshotTestJSON-1949254885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='517883471ec747278f78d0329efcccf6',uuid=2571d92c-f0c2-4cff-b715-7610cc251145,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converting VIF {"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=ea1c95ce-c5e9-4527-b6ef-8aceea0648a7,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1c95ce-c5') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'pci_devices' on Instance uuid 2571d92c-f0c2-4cff-b715-7610cc251145 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:22:11 user nova-compute[72178]:   <uuid>2571d92c-f0c2-4cff-b715-7610cc251145</uuid>
Aug 01 12:22:11 user nova-compute[72178]:   <name>instance-00000030</name>
Aug 01 12:22:11 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:22:11 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:22:11 user nova-compute[72178]:   <metadata>
Aug 01 12:22:11 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:22:11 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:22:11 user nova-compute[72178]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-714379269</nova:name>
Aug 01 12:22:11 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:22:11</nova:creationTime>
Aug 01 12:22:11 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:22:11 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:22:11 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:22:11 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:22:11 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:22:11 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:22:11 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:22:11 user nova-compute[72178]:       <nova:owner>
Aug 01 12:22:11 user nova-compute[72178]:         <nova:user uuid="517883471ec747278f78d0329efcccf6">tempest-VolumesSnapshotTestJSON-1949254885-project-member</nova:user>
Aug 01 12:22:11 user nova-compute[72178]:         <nova:project uuid="c3e2397edfe04144b7eaea8d06ceb971">tempest-VolumesSnapshotTestJSON-1949254885</nova:project>
Aug 01 12:22:11 user nova-compute[72178]:       </nova:owner>
Aug 01 12:22:11 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:22:11 user nova-compute[72178]:       <nova:ports>
Aug 01 12:22:11 user nova-compute[72178]:         <nova:port uuid="ea1c95ce-c5e9-4527-b6ef-8aceea0648a7">
Aug 01 12:22:11 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 01 12:22:11 user nova-compute[72178]:         </nova:port>
Aug 01 12:22:11 user nova-compute[72178]:       </nova:ports>
Aug 01 12:22:11 user nova-compute[72178]:     </nova:instance>
Aug 01 12:22:11 user nova-compute[72178]:   </metadata>
Aug 01 12:22:11 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:22:11 user nova-compute[72178]:     <system>
Aug 01 12:22:11 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:22:11 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:22:11 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:22:11 user nova-compute[72178]:       <entry name="serial">2571d92c-f0c2-4cff-b715-7610cc251145</entry>
Aug 01 12:22:11 user nova-compute[72178]:       <entry name="uuid">2571d92c-f0c2-4cff-b715-7610cc251145</entry>
Aug 01 12:22:11 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:22:11 user nova-compute[72178]:     </system>
Aug 01 12:22:11 user nova-compute[72178]:   </sysinfo>
Aug 01 12:22:11 user nova-compute[72178]:   <os>
Aug 01 12:22:11 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:22:11 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:22:11 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:22:11 user nova-compute[72178]:   </os>
Aug 01 12:22:11 user nova-compute[72178]:   <features>
Aug 01 12:22:11 user nova-compute[72178]:     <acpi/>
Aug 01 12:22:11 user nova-compute[72178]:     <apic/>
Aug 01 12:22:11 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:22:11 user nova-compute[72178]:   </features>
Aug 01 12:22:11 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:22:11 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:22:11 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:22:11 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:22:11 user nova-compute[72178]:   </clock>
Aug 01 12:22:11 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:22:11 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:22:11 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:22:11 user nova-compute[72178]:   </cpu>
Aug 01 12:22:11 user nova-compute[72178]:   <devices>
Aug 01 12:22:11 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:22:11 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:22:11 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk"/>
Aug 01 12:22:11 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:22:11 user nova-compute[72178]:     </disk>
Aug 01 12:22:11 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:22:11 user nova-compute[72178]:       <mac address="fa:16:3e:e4:78:8d"/>
Aug 01 12:22:11 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:22:11 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:22:11 user nova-compute[72178]:       <target dev="tapea1c95ce-c5"/>
Aug 01 12:22:11 user nova-compute[72178]:     </interface>
Aug 01 12:22:11 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:22:11 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/console.log" append="off"/>
Aug 01 12:22:11 user nova-compute[72178]:     </serial>
Aug 01 12:22:11 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:22:11 user nova-compute[72178]:     <video>
Aug 01 12:22:11 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:22:11 user nova-compute[72178]:     </video>
Aug 01 12:22:11 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:22:11 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:22:11 user nova-compute[72178]:     </rng>
Aug 01 12:22:11 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:22:11 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:22:11 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:22:11 user nova-compute[72178]:     </memballoon>
Aug 01 12:22:11 user nova-compute[72178]:   </devices>
Aug 01 12:22:11 user nova-compute[72178]: </domain>
Aug 01 12:22:11 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-714379269',display_name='tempest-VolumesSnapshotTestJSON-instance-714379269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-714379269',id=48,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++WmGi2brBWHrIOiLTcBOYOxQawHhInI5h58T+PwvGjOTq7FTX/u1TEBEE/FdOaylnRjknSvLldKVyuRz0yCGGcXIQSLAUtIvYyF+DlErw/UcS2Q7z/nTad4x0cf5c5Q==',key_name='tempest-keypair-1921959805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3e2397edfe04144b7eaea8d06ceb971',ramdisk_id='',reservation_id='r-ot5kqy04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1949254885',owner_user_name='tempest-VolumesSnapshotTestJSON-1949254885-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:22:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='517883471ec747278f78d0329efcccf6',uuid=2571d92c-f0c2-4cff-b715-7610cc251145,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converting VIF {"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=ea1c95ce-c5e9-4527-b6ef-8aceea0648a7,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1c95ce-c5') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG os_vif [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=ea1c95ce-c5e9-4527-b6ef-8aceea0648a7,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1c95ce-c5') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea1c95ce-c5, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapea1c95ce-c5, col_values=(('external_ids', {'iface-id': 'ea1c95ce-c5e9-4527-b6ef-8aceea0648a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:78:8d', 'vm-uuid': '2571d92c-f0c2-4cff-b715-7610cc251145'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:22:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:12 user nova-compute[72178]: INFO os_vif [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=ea1c95ce-c5e9-4527-b6ef-8aceea0648a7,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1c95ce-c5')
Aug 01 12:22:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:22:12 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No VIF found with MAC fa:16:3e:e4:78:8d, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:22:12 user nova-compute[72178]: DEBUG nova.network.neutron [req-bbec7edf-1d0c-4be3-a83b-cc40a7ccb94f req-365b12c9-4aeb-4114-b9c9-99a923075236 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Updated VIF entry in instance network info cache for port ea1c95ce-c5e9-4527-b6ef-8aceea0648a7. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:22:12 user nova-compute[72178]: DEBUG nova.network.neutron [req-bbec7edf-1d0c-4be3-a83b-cc40a7ccb94f req-365b12c9-4aeb-4114-b9c9-99a923075236 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Updating instance_info_cache with network_info: [{"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:22:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-bbec7edf-1d0c-4be3-a83b-cc40a7ccb94f req-365b12c9-4aeb-4114-b9c9-99a923075236 service nova] Releasing lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-a8cafce2-5e29-4558-bfca-c00ff30649d7 req-1bb006fd-85e0-4033-ab23-b0eb13445a2e service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received event network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a8cafce2-5e29-4558-bfca-c00ff30649d7 req-1bb006fd-85e0-4033-ab23-b0eb13445a2e service nova] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a8cafce2-5e29-4558-bfca-c00ff30649d7 req-1bb006fd-85e0-4033-ab23-b0eb13445a2e service nova] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a8cafce2-5e29-4558-bfca-c00ff30649d7 req-1bb006fd-85e0-4033-ab23-b0eb13445a2e service nova] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-a8cafce2-5e29-4558-bfca-c00ff30649d7 req-1bb006fd-85e0-4033-ab23-b0eb13445a2e service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] No waiting events found dispatching network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:22:13 user nova-compute[72178]: WARNING nova.compute.manager [req-a8cafce2-5e29-4558-bfca-c00ff30649d7 req-1bb006fd-85e0-4033-ab23-b0eb13445a2e service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received unexpected event network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 for instance with vm_state building and task_state spawning.
Aug 01 12:22:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892535.3565023, 2571d92c-f0c2-4cff-b715-7610cc251145 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:22:15 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] VM Resumed (Lifecycle Event)
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:22:15 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Instance spawned successfully.
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:22:15 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892535.3588378, 2571d92c-f0c2-4cff-b715-7610cc251145 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:22:15 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] VM Started (Lifecycle Event)
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:22:15 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:22:15 user nova-compute[72178]: INFO nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:22:15 user nova-compute[72178]: INFO nova.compute.manager [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Took 6.13 seconds to build instance.
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-b9cde0cb-b81d-4017-9bef-887c5db69fe9 req-8cc1556d-1830-485b-aa84-ed3a0c2257f3 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received event network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b9cde0cb-b81d-4017-9bef-887c5db69fe9 req-8cc1556d-1830-485b-aa84-ed3a0c2257f3 service nova] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b9cde0cb-b81d-4017-9bef-887c5db69fe9 req-8cc1556d-1830-485b-aa84-ed3a0c2257f3 service nova] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-b9cde0cb-b81d-4017-9bef-887c5db69fe9 req-8cc1556d-1830-485b-aa84-ed3a0c2257f3 service nova] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:15 user nova-compute[72178]: DEBUG nova.compute.manager [req-b9cde0cb-b81d-4017-9bef-887c5db69fe9 req-8cc1556d-1830-485b-aa84-ed3a0c2257f3 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] No waiting events found dispatching network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:22:15 user nova-compute[72178]: WARNING nova.compute.manager [req-b9cde0cb-b81d-4017-9bef-887c5db69fe9 req-8cc1556d-1830-485b-aa84-ed3a0c2257f3 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received unexpected event network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 for instance with vm_state active and task_state None.
Aug 01 12:22:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a144b552-a740-46a8-9eca-29afed111a7f tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.223s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-7492afb0-8953-4624-a631-2f11bf53a581 req-132c60c4-119b-43cc-8402-7306d72ffd3b service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received event network-changed-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-7492afb0-8953-4624-a631-2f11bf53a581 req-132c60c4-119b-43cc-8402-7306d72ffd3b service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Refreshing instance network info cache due to event network-changed-7eacccce-d3b6-4750-9a19-2852f48b57e3. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7492afb0-8953-4624-a631-2f11bf53a581 req-132c60c4-119b-43cc-8402-7306d72ffd3b service nova] Acquiring lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7492afb0-8953-4624-a631-2f11bf53a581 req-132c60c4-119b-43cc-8402-7306d72ffd3b service nova] Acquired lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-7492afb0-8953-4624-a631-2f11bf53a581 req-132c60c4-119b-43cc-8402-7306d72ffd3b service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Refreshing network info cache for port 7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:18 user nova-compute[72178]: INFO nova.compute.manager [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Terminating instance
Aug 01 12:22:18 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-7492afb0-8953-4624-a631-2f11bf53a581 req-132c60c4-119b-43cc-8402-7306d72ffd3b service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updated VIF entry in instance network info cache for port 7eacccce-d3b6-4750-9a19-2852f48b57e3. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.network.neutron [req-7492afb0-8953-4624-a631-2f11bf53a581 req-132c60c4-119b-43cc-8402-7306d72ffd3b service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updating instance_info_cache with network_info: [{"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7492afb0-8953-4624-a631-2f11bf53a581 req-132c60c4-119b-43cc-8402-7306d72ffd3b service nova] Releasing lock "refresh_cache-53f00180-560e-486e-92a9-558bed951f36" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:22:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 53f00180-560e-486e-92a9-558bed951f36] Instance destroyed successfully.
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.objects.instance [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'resources' on Instance uuid 53f00180-560e-486e-92a9-558bed951f36 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1382486598',display_name='tempest-TestStampPattern-server-1382486598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1382486598',id=42,image_ref='6bc8e4c4-2030-4644-8569-da91fde6f987',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY0D3vdAXP1Uw5iOPQrUFMzzsglvj6jvcAFaLJfftLI5qdjFbF3qmMqlBS6g6gXV6f3NDdy+mfkiStVBeHEEmPFhi29WKhEbf8vOEiEeuKxD5jDUbAuPzUzAbvJ63afJA==',key_name='tempest-TestStampPattern-274602689',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0af152857bb640f591e8f0a09ff89837',ramdisk_id='',reservation_id='r-vpczjglr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f0ef243f-6c58-4991-97b1-0883d24dd6c9',image_min_disk='1',image_min_ram='0',image_owner_id='0af152857bb640f591e8f0a09ff89837',image_owner_project_name='tempest-TestStampPattern-1531717549',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1531717549-project-member',image_user_id='fae1f92a5fa44879a3a523589e12a5ef',owner_project_name='tempest-TestStampPattern-1531717549',owner_user_name='tempest-TestStampPattern-1531717549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:19:31Z,user_data=None,user_id='fae1f92a5fa44879a3a523589e12a5ef',uuid=53f00180-560e-486e-92a9-558bed951f36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converting VIF {"id": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "address": "fa:16:3e:ce:f6:dd", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eacccce-d3", "ovs_interfaceid": "7eacccce-d3b6-4750-9a19-2852f48b57e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=7eacccce-d3b6-4750-9a19-2852f48b57e3,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eacccce-d3') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG os_vif [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=7eacccce-d3b6-4750-9a19-2852f48b57e3,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eacccce-d3') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eacccce-d3, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:22:19 user nova-compute[72178]: INFO os_vif [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:f6:dd,bridge_name='br-int',has_traffic_filtering=True,id=7eacccce-d3b6-4750-9a19-2852f48b57e3,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eacccce-d3')
Aug 01 12:22:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Deleting instance files /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36_del
Aug 01 12:22:19 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Deletion of /opt/stack/data/nova/instances/53f00180-560e-486e-92a9-558bed951f36_del complete
Aug 01 12:22:19 user nova-compute[72178]: INFO nova.compute.manager [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: 53f00180-560e-486e-92a9-558bed951f36] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 12:22:19 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 53f00180-560e-486e-92a9-558bed951f36] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 53f00180-560e-486e-92a9-558bed951f36] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 53f00180-560e-486e-92a9-558bed951f36] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:22:19 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 53f00180-560e-486e-92a9-558bed951f36] Took 0.52 seconds to deallocate network for instance.
Aug 01 12:22:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-afb3b594-7523-4f9a-818c-899e7778bf16 req-16bdf3ba-d25c-4692-8b86-e603a6449a59 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received event network-vif-deleted-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:20 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Deleted allocations for instance 53f00180-560e-486e-92a9-558bed951f36
Aug 01 12:22:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-0f7c8295-f011-4a8f-b362-6e314178e4e0 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "53f00180-560e-486e-92a9-558bed951f36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.943s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received event network-vif-unplugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] Lock "53f00180-560e-486e-92a9-558bed951f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] Lock "53f00180-560e-486e-92a9-558bed951f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] No waiting events found dispatching network-vif-unplugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:22:20 user nova-compute[72178]: WARNING nova.compute.manager [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received unexpected event network-vif-unplugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 for instance with vm_state deleted and task_state None.
Aug 01 12:22:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received event network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] Acquiring lock "53f00180-560e-486e-92a9-558bed951f36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] Lock "53f00180-560e-486e-92a9-558bed951f36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] Lock "53f00180-560e-486e-92a9-558bed951f36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] No waiting events found dispatching network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:22:20 user nova-compute[72178]: WARNING nova.compute.manager [req-04a9ed67-e83a-4fa7-998a-47ea5e43cb1b req-9d5b2ee9-d10f-4e42-833b-b2557988e4b9 service nova] [instance: 53f00180-560e-486e-92a9-558bed951f36] Received unexpected event network-vif-plugged-7eacccce-d3b6-4750-9a19-2852f48b57e3 for instance with vm_state deleted and task_state None.
Aug 01 12:22:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:34 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892539.125119, 53f00180-560e-486e-92a9-558bed951f36 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:22:34 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 53f00180-560e-486e-92a9-558bed951f36] VM Stopped (Lifecycle Event)
Aug 01 12:22:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-520ec54d-8ec3-4b7a-bd07-7f209783417b None None] [instance: 53f00180-560e-486e-92a9-558bed951f36] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:22:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [{"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-6c816328-61df-4625-95e6-bc27fbd7148d" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:22:41 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:22:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:48 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:22:50 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:22:50 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=25.037330627441406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 6c816328-61df-4625-95e6-bc27fbd7148d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f0ef243f-6c58-4991-97b1-0883d24dd6c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 051b1b49-f5b2-400d-ac88-b841439743ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance cb59098f-6c2f-4f58-9e83-a3898328625b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance de5dede0-6d6c-489d-8ce0-cd8fcd51f20c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 2571d92c-f0c2-4cff-b715-7610cc251145 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:22:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:22:51 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:22:51 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:22:51 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:22:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:53 user nova-compute[72178]: INFO nova.compute.manager [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Terminating instance
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-390830df-4050-447e-8977-4c2644a7254f req-3e326c4d-a24c-4d1d-a1db-a14cfe270de0 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-390830df-4050-447e-8977-4c2644a7254f req-3e326c4d-a24c-4d1d-a1db-a14cfe270de0 service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-390830df-4050-447e-8977-4c2644a7254f req-3e326c4d-a24c-4d1d-a1db-a14cfe270de0 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-390830df-4050-447e-8977-4c2644a7254f req-3e326c4d-a24c-4d1d-a1db-a14cfe270de0 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-390830df-4050-447e-8977-4c2644a7254f req-3e326c4d-a24c-4d1d-a1db-a14cfe270de0 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-390830df-4050-447e-8977-4c2644a7254f req-3e326c4d-a24c-4d1d-a1db-a14cfe270de0 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-unplugged-e15e122f-e600-4d15-a508-998a84817013 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Instance destroyed successfully.
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.objects.instance [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'resources' on Instance uuid 6c816328-61df-4625-95e6-bc27fbd7148d {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:13:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1912286508',display_name='tempest-AttachVolumeTestJSON-server-1912286508',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1912286508',id=36,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+1M4hqhHHhYi7fqaEC8VnG4HhXGPioqdE2DBe5v5BfrTyDtqf20pJ1c6Ruvd7MOsiyiWabpzFghbYEsyqoy35NQWIUpUOZPhDbq42ybxg3XET1dd/jtAQtnm15hSZ1Pw==',key_name='tempest-keypair-2058927339',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-q89n6cb0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=6c816328-61df-4625-95e6-bc27fbd7148d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "e15e122f-e600-4d15-a508-998a84817013", "address": "fa:16:3e:de:3e:66", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape15e122f-e6", "ovs_interfaceid": "e15e122f-e600-4d15-a508-998a84817013", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG os_vif [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape15e122f-e6, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:22:53 user nova-compute[72178]: INFO os_vif [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=e15e122f-e600-4d15-a508-998a84817013,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape15e122f-e6')
Aug 01 12:22:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Deleting instance files /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d_del
Aug 01 12:22:53 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Deletion of /opt/stack/data/nova/instances/6c816328-61df-4625-95e6-bc27fbd7148d_del complete
Aug 01 12:22:53 user nova-compute[72178]: INFO nova.compute.manager [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 12:22:53 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:22:53 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:22:54 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Took 0.79 seconds to deallocate network for instance.
Aug 01 12:22:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-568f11c0-1345-46ca-875d-fec78e6999ff req-8b2585e8-57f2-473a-814d-d163643e4046 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-deleted-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:54 user nova-compute[72178]: INFO nova.compute.manager [req-568f11c0-1345-46ca-875d-fec78e6999ff req-8b2585e8-57f2-473a-814d-d163643e4046 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Neutron deleted interface e15e122f-e600-4d15-a508-998a84817013; detaching it from the instance and deleting it from the info cache
Aug 01 12:22:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-568f11c0-1345-46ca-875d-fec78e6999ff req-8b2585e8-57f2-473a-814d-d163643e4046 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG nova.compute.manager [req-568f11c0-1345-46ca-875d-fec78e6999ff req-8b2585e8-57f2-473a-814d-d163643e4046 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Detach interface failed, port_id=e15e122f-e600-4d15-a508-998a84817013, reason: Instance 6c816328-61df-4625-95e6-bc27fbd7148d could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:22:54 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:22:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:55 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Deleted allocations for instance 6c816328-61df-4625-95e6-bc27fbd7148d
Aug 01 12:22:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-37138a2c-ea40-402d-812c-03a4d9f117a6 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "6c816328-61df-4625-95e6-bc27fbd7148d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.147s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-5b28104c-4a06-4059-bb09-ffec611627b2 req-2e073432-cff3-4e63-87a7-b2aec8c0ac13 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:22:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5b28104c-4a06-4059-bb09-ffec611627b2 req-2e073432-cff3-4e63-87a7-b2aec8c0ac13 service nova] Acquiring lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:22:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5b28104c-4a06-4059-bb09-ffec611627b2 req-2e073432-cff3-4e63-87a7-b2aec8c0ac13 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:22:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-5b28104c-4a06-4059-bb09-ffec611627b2 req-2e073432-cff3-4e63-87a7-b2aec8c0ac13 service nova] Lock "6c816328-61df-4625-95e6-bc27fbd7148d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:22:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-5b28104c-4a06-4059-bb09-ffec611627b2 req-2e073432-cff3-4e63-87a7-b2aec8c0ac13 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] No waiting events found dispatching network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:22:55 user nova-compute[72178]: WARNING nova.compute.manager [req-5b28104c-4a06-4059-bb09-ffec611627b2 req-2e073432-cff3-4e63-87a7-b2aec8c0ac13 service nova] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Received unexpected event network-vif-plugged-e15e122f-e600-4d15-a508-998a84817013 for instance with vm_state deleted and task_state None.
Aug 01 12:22:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:08 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892573.7712824, 6c816328-61df-4625-95e6-bc27fbd7148d => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:23:08 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] VM Stopped (Lifecycle Event)
Aug 01 12:23:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-0b69c244-d25f-4568-b2e2-f5f19c331012 None None] [instance: 6c816328-61df-4625-95e6-bc27fbd7148d] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:23:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:23:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:23:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:23:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-e95d0df0-fa7f-427b-946d-ab8f99dbc4c7 req-c353ccc9-5e78-40f6-b953-756eaafff898 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received event network-changed-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG nova.compute.manager [req-e95d0df0-fa7f-427b-946d-ab8f99dbc4c7 req-c353ccc9-5e78-40f6-b953-756eaafff898 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Refreshing instance network info cache due to event network-changed-f1f6d4f4-e0a4-4122-a499-2b0022a12570. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e95d0df0-fa7f-427b-946d-ab8f99dbc4c7 req-c353ccc9-5e78-40f6-b953-756eaafff898 service nova] Acquiring lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e95d0df0-fa7f-427b-946d-ab8f99dbc4c7 req-c353ccc9-5e78-40f6-b953-756eaafff898 service nova] Acquired lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG nova.network.neutron [req-e95d0df0-fa7f-427b-946d-ab8f99dbc4c7 req-c353ccc9-5e78-40f6-b953-756eaafff898 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Refreshing network info cache for port f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG nova.network.neutron [req-e95d0df0-fa7f-427b-946d-ab8f99dbc4c7 req-c353ccc9-5e78-40f6-b953-756eaafff898 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Updated VIF entry in instance network info cache for port f1f6d4f4-e0a4-4122-a499-2b0022a12570. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG nova.network.neutron [req-e95d0df0-fa7f-427b-946d-ab8f99dbc4c7 req-c353ccc9-5e78-40f6-b953-756eaafff898 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Updating instance_info_cache with network_info: [{"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e95d0df0-fa7f-427b-946d-ab8f99dbc4c7 req-c353ccc9-5e78-40f6-b953-756eaafff898 service nova] Releasing lock "refresh_cache-e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:23:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:16 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:23:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:17 user nova-compute[72178]: INFO nova.compute.manager [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Attaching volume cf2e66a0-5d08-4297-8fa6-812766ddfa8c to /dev/vdb
Aug 01 12:23:17 user nova-compute[72178]: DEBUG os_brick.utils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4f2c0b-1740-4702-9a1e-66d129f31f06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37cc80f-2b73-4e78-a639-aa50d564af08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d896296-887c-4151-a4a7-61697f5606c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82ece27-f2c7-4536-a039-04f7f27cc21f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:23:17 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e883e89b-67b7-450e-85c2-c902a7f5116d]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG os_brick.utils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Updating existing volume attachment record: c1a748ec-5b63-42cd-b076-329e678f5299 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-93436dc0-c8ab-437c-9593-9600627db0a9 req-016aff6b-7f50-4399-b309-1954bd0fbe71 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-changed-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-93436dc0-c8ab-437c-9593-9600627db0a9 req-016aff6b-7f50-4399-b309-1954bd0fbe71 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Refreshing instance network info cache due to event network-changed-4aea2bba-76d8-441e-a325-eccd19b2194f. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-93436dc0-c8ab-437c-9593-9600627db0a9 req-016aff6b-7f50-4399-b309-1954bd0fbe71 service nova] Acquiring lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-93436dc0-c8ab-437c-9593-9600627db0a9 req-016aff6b-7f50-4399-b309-1954bd0fbe71 service nova] Acquired lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG nova.network.neutron [req-93436dc0-c8ab-437c-9593-9600627db0a9 req-016aff6b-7f50-4399-b309-1954bd0fbe71 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Refreshing network info cache for port 4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:17 user nova-compute[72178]: INFO nova.compute.manager [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Terminating instance
Aug 01 12:23:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-26b38426-c2b1-423e-803d-f1104a536824 req-e2038f1c-dc9b-48ca-823f-73cc5ef21afb service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-vif-unplugged-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-26b38426-c2b1-423e-803d-f1104a536824 req-e2038f1c-dc9b-48ca-823f-73cc5ef21afb service nova] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-26b38426-c2b1-423e-803d-f1104a536824 req-e2038f1c-dc9b-48ca-823f-73cc5ef21afb service nova] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-26b38426-c2b1-423e-803d-f1104a536824 req-e2038f1c-dc9b-48ca-823f-73cc5ef21afb service nova] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-26b38426-c2b1-423e-803d-f1104a536824 req-e2038f1c-dc9b-48ca-823f-73cc5ef21afb service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] No waiting events found dispatching network-vif-unplugged-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:23:17 user nova-compute[72178]: DEBUG nova.compute.manager [req-26b38426-c2b1-423e-803d-f1104a536824 req-e2038f1c-dc9b-48ca-823f-73cc5ef21afb service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-vif-unplugged-4aea2bba-76d8-441e-a325-eccd19b2194f for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-93436dc0-c8ab-437c-9593-9600627db0a9 req-016aff6b-7f50-4399-b309-1954bd0fbe71 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updated VIF entry in instance network info cache for port 4aea2bba-76d8-441e-a325-eccd19b2194f. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.network.neutron [req-93436dc0-c8ab-437c-9593-9600627db0a9 req-016aff6b-7f50-4399-b309-1954bd0fbe71 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updating instance_info_cache with network_info: [{"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-93436dc0-c8ab-437c-9593-9600627db0a9 req-016aff6b-7f50-4399-b309-1954bd0fbe71 service nova] Releasing lock "refresh_cache-f0ef243f-6c58-4991-97b1-0883d24dd6c9" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:23:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Instance destroyed successfully.
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lazy-loading 'resources' on Instance uuid f0ef243f-6c58-4991-97b1-0883d24dd6c9 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:16:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-220539021',display_name='tempest-TestStampPattern-server-220539021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-220539021',id=38,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLY0D3vdAXP1Uw5iOPQrUFMzzsglvj6jvcAFaLJfftLI5qdjFbF3qmMqlBS6g6gXV6f3NDdy+mfkiStVBeHEEmPFhi29WKhEbf8vOEiEeuKxD5jDUbAuPzUzAbvJ63afJA==',key_name='tempest-TestStampPattern-274602689',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:16:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0af152857bb640f591e8f0a09ff89837',ramdisk_id='',reservation_id='r-oyl8aux2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1531717549',owner_user_name='tempest-TestStampPattern-1531717549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:19:21Z,user_data=None,user_id='fae1f92a5fa44879a3a523589e12a5ef',uuid=f0ef243f-6c58-4991-97b1-0883d24dd6c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converting VIF {"id": "4aea2bba-76d8-441e-a325-eccd19b2194f", "address": "fa:16:3e:ed:5a:ba", "network": {"id": "6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3", "bridge": "br-int", "label": "tempest-TestStampPattern-1111505476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af152857bb640f591e8f0a09ff89837", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aea2bba-76", "ovs_interfaceid": "4aea2bba-76d8-441e-a325-eccd19b2194f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:5a:ba,bridge_name='br-int',has_traffic_filtering=True,id=4aea2bba-76d8-441e-a325-eccd19b2194f,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aea2bba-76') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG os_vif [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:5a:ba,bridge_name='br-int',has_traffic_filtering=True,id=4aea2bba-76d8-441e-a325-eccd19b2194f,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aea2bba-76') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aea2bba-76, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:18 user nova-compute[72178]: INFO os_vif [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:5a:ba,bridge_name='br-int',has_traffic_filtering=True,id=4aea2bba-76d8-441e-a325-eccd19b2194f,network=Network(6f59c5a5-5c64-4d8b-a97a-84c9e3a669b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aea2bba-76')
Aug 01 12:23:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Deleting instance files /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9_del
Aug 01 12:23:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Deletion of /opt/stack/data/nova/instances/f0ef243f-6c58-4991-97b1-0883d24dd6c9_del complete
Aug 01 12:23:18 user nova-compute[72178]: INFO nova.compute.manager [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 12:23:18 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:18 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Took 0.48 seconds to deallocate network for instance.
Aug 01 12:23:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:19 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Deleted allocations for instance f0ef243f-6c58-4991-97b1-0883d24dd6c9
Aug 01 12:23:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-1c2408ba-403c-4916-9d93-8c1165f94d55 tempest-TestStampPattern-1531717549 tempest-TestStampPattern-1531717549-project-member] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.803s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-c8300ab2-8cfe-4bb7-b847-c51b807f2fe2 req-8e6a79fc-8a76-4daa-bd15-8bd5b50f2293 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-vif-deleted-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-a90b5d7f-6ba1-4aee-a489-a2b0fb9d8c5c req-20b6e452-7b00-418c-8425-84c8ba64dbc3 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received event network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a90b5d7f-6ba1-4aee-a489-a2b0fb9d8c5c req-20b6e452-7b00-418c-8425-84c8ba64dbc3 service nova] Acquiring lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a90b5d7f-6ba1-4aee-a489-a2b0fb9d8c5c req-20b6e452-7b00-418c-8425-84c8ba64dbc3 service nova] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a90b5d7f-6ba1-4aee-a489-a2b0fb9d8c5c req-20b6e452-7b00-418c-8425-84c8ba64dbc3 service nova] Lock "f0ef243f-6c58-4991-97b1-0883d24dd6c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-a90b5d7f-6ba1-4aee-a489-a2b0fb9d8c5c req-20b6e452-7b00-418c-8425-84c8ba64dbc3 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] No waiting events found dispatching network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:23:19 user nova-compute[72178]: WARNING nova.compute.manager [req-a90b5d7f-6ba1-4aee-a489-a2b0fb9d8c5c req-20b6e452-7b00-418c-8425-84c8ba64dbc3 service nova] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Received unexpected event network-vif-plugged-4aea2bba-76d8-441e-a325-eccd19b2194f for instance with vm_state deleted and task_state None.
Aug 01 12:23:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "cb59098f-6c2f-4f58-9e83-a3898328625b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:24 user nova-compute[72178]: INFO nova.compute.manager [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Terminating instance
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.compute.manager [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-f492baa6-ac69-431d-a96f-f53aa13992a8 req-6b395dbd-38df-47fd-8143-48ba432bc2d5 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received event network-vif-unplugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f492baa6-ac69-431d-a96f-f53aa13992a8 req-6b395dbd-38df-47fd-8143-48ba432bc2d5 service nova] Acquiring lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f492baa6-ac69-431d-a96f-f53aa13992a8 req-6b395dbd-38df-47fd-8143-48ba432bc2d5 service nova] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-f492baa6-ac69-431d-a96f-f53aa13992a8 req-6b395dbd-38df-47fd-8143-48ba432bc2d5 service nova] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-f492baa6-ac69-431d-a96f-f53aa13992a8 req-6b395dbd-38df-47fd-8143-48ba432bc2d5 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] No waiting events found dispatching network-vif-unplugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.compute.manager [req-f492baa6-ac69-431d-a96f-f53aa13992a8 req-6b395dbd-38df-47fd-8143-48ba432bc2d5 service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received event network-vif-unplugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'touLYIXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:23:24 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:23:24 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:23:24 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a164f641-d203-4439-8452-99b57a4f6283]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:23:24 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef007752-aace-403e-8c9c-3db35306f5d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c] added
Aug 01 12:23:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[791e8ef0-c5a8-4add-acbf-55bd3904ac4e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Instance destroyed successfully.
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.objects.instance [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lazy-loading 'resources' on Instance uuid cb59098f-6c2f-4f58-9e83-a3898328625b {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1207429464',display_name='tempest-ServersNegativeTestJSON-server-1207429464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1207429464',id=46,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5744024985c24187a2add045778a28df',ramdisk_id='',reservation_id='r-rokh8750',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1559526557',owner_user_name='tempest-ServersNegativeTestJSON-1559526557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:21:41Z,user_data=None,user_id='923afe9bd6654c02b9a2dc0d2c7aacd9',uuid=cb59098f-6c2f-4f58-9e83-a3898328625b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converting VIF {"id": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "address": "fa:16:3e:56:53:23", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0965ecb-4f", "ovs_interfaceid": "b0965ecb-4ff6-4e61-b813-e4809ffc3d2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:53:23,bridge_name='br-int',has_traffic_filtering=True,id=b0965ecb-4ff6-4e61-b813-e4809ffc3d2e,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0965ecb-4f') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_vif [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:53:23,bridge_name='br-int',has_traffic_filtering=True,id=b0965ecb-4ff6-4e61-b813-e4809ffc3d2e,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0965ecb-4f') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5909e1-5d7c-4341-b28e-5a8cde2abec9]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0965ecb-4f, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v touLYIXz {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:24 user nova-compute[72178]: INFO os_vif [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:53:23,bridge_name='br-int',has_traffic_filtering=True,id=b0965ecb-4ff6-4e61-b813-e4809ffc3d2e,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0965ecb-4f')
Aug 01 12:23:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Deleting instance files /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b_del
Aug 01 12:23:24 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Deletion of /opt/stack/data/nova/instances/cb59098f-6c2f-4f58-9e83-a3898328625b_del complete
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v touLYIXz" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c3c9d8-3ab8-40a6-96a0-baefb09e1ada]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'touLYIXz'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe5dacb-673b-45d1-9bce-8634e3084b38]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3c38d5-efa9-471a-bfab-1423aebafc67]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:23:24 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:23:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:23:24 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:23:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:23:24 user nova-compute[72178]: INFO nova.compute.manager [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ccf254-7e39-4598-a90e-982753230daa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c, portal: 172.16.0.220,3260]
Aug 01 12:23:24 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c, portal: 172.16.0.220,3260] successful.
Aug 01 12:23:24 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:24 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8006e22e-0f3b-45e4-9f72-3bd579009061]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e6ac13-bcfd-4165-83c8-79f936a2bf08]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:23:25 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:23:25 user nova-compute[72178]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c (non-flash)
Aug 01 12:23:25 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:23:25 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:23:25 user nova-compute[72178]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c (non-flash)
Aug 01 12:23:25 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8ab67d-9790-41cc-a61a-a1da49225465]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:23:25 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'touLYIXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23634663232323739', 'path': '/dev/sdd'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634663232323739', 'path': '/dev/sdd'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.objects.instance [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:23:26 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:23:26 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:23:26 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:23:26 user nova-compute[72178]:   <serial>cf2e66a0-5d08-4297-8fa6-812766ddfa8c</serial>
Aug 01 12:23:26 user nova-compute[72178]: </disk>
Aug 01 12:23:26 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:23:26 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Took 1.24 seconds to deallocate network for instance.
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.compute.manager [req-e11ff410-3675-4263-ac77-5a04c9b70a3e req-ff2ad3ce-51a6-4725-a9a4-f8f9691cdaac service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received event network-vif-deleted-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:26 user nova-compute[72178]: INFO nova.compute.manager [req-e11ff410-3675-4263-ac77-5a04c9b70a3e req-ff2ad3ce-51a6-4725-a9a4-f8f9691cdaac service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Neutron deleted interface b0965ecb-4ff6-4e61-b813-e4809ffc3d2e; detaching it from the instance and deleting it from the info cache
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.network.neutron [req-e11ff410-3675-4263-ac77-5a04c9b70a3e req-ff2ad3ce-51a6-4725-a9a4-f8f9691cdaac service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.compute.manager [req-e11ff410-3675-4263-ac77-5a04c9b70a3e req-ff2ad3ce-51a6-4725-a9a4-f8f9691cdaac service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Detach interface failed, port_id=b0965ecb-4ff6-4e61-b813-e4809ffc3d2e, reason: Instance cb59098f-6c2f-4f58-9e83-a3898328625b could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.compute.manager [req-14668da9-5057-4417-9177-56dc24a30732 req-9b598e39-3a13-4b35-a49d-7b3f7126195e service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received event network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-14668da9-5057-4417-9177-56dc24a30732 req-9b598e39-3a13-4b35-a49d-7b3f7126195e service nova] Acquiring lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-14668da9-5057-4417-9177-56dc24a30732 req-9b598e39-3a13-4b35-a49d-7b3f7126195e service nova] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-14668da9-5057-4417-9177-56dc24a30732 req-9b598e39-3a13-4b35-a49d-7b3f7126195e service nova] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.compute.manager [req-14668da9-5057-4417-9177-56dc24a30732 req-9b598e39-3a13-4b35-a49d-7b3f7126195e service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] No waiting events found dispatching network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:23:26 user nova-compute[72178]: WARNING nova.compute.manager [req-14668da9-5057-4417-9177-56dc24a30732 req-9b598e39-3a13-4b35-a49d-7b3f7126195e service nova] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Received unexpected event network-vif-plugged-b0965ecb-4ff6-4e61-b813-e4809ffc3d2e for instance with vm_state deleted and task_state None.
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:26 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Deleted allocations for instance cb59098f-6c2f-4f58-9e83-a3898328625b
Aug 01 12:23:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-ea647985-7e7e-4b0c-b65c-8a6f3f362798 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "cb59098f-6c2f-4f58-9e83-a3898328625b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.472s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] No VIF found with MAC fa:16:3e:ed:94:bc, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:23:26 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-7a9a62af-bbdd-499f-ae60-7d929438ce59 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.534s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:27 user nova-compute[72178]: INFO nova.compute.manager [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Detaching volume cf2e66a0-5d08-4297-8fa6-812766ddfa8c
Aug 01 12:23:27 user nova-compute[72178]: INFO nova.virt.block_device [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Attempting to driver detach volume cf2e66a0-5d08-4297-8fa6-812766ddfa8c from mountpoint /dev/vdb
Aug 01 12:23:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Attempting to detach device vdb from instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:23:27 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:23:27 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:23:27 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:23:27 user nova-compute[72178]:   <serial>cf2e66a0-5d08-4297-8fa6-812766ddfa8c</serial>
Aug 01 12:23:27 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:23:27 user nova-compute[72178]: </disk>
Aug 01 12:23:27 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:23:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully detached device vdb from instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb from the persistent domain config.
Aug 01 12:23:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:23:27 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:23:27 user nova-compute[72178]:   <source dev="/dev/sdd"/>
Aug 01 12:23:27 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:23:27 user nova-compute[72178]:   <serial>cf2e66a0-5d08-4297-8fa6-812766ddfa8c</serial>
Aug 01 12:23:27 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:23:27 user nova-compute[72178]: </disk>
Aug 01 12:23:27 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892607.6995325, e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:23:27 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully detached device vdb from instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb from the live domain config.
Aug 01 12:23:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'touLYIXz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:23:27 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed94bb4f-dab4-413c-b411-f24c26211029]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23700d5-deb9-4ce6-9c2b-c4b87d565877]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:23:27 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:23:27 user nova-compute[72178]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c (non-flash)
Aug 01 12:23:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:23:27 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:23:27 user nova-compute[72178]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c (non-flash)
Aug 01 12:23:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f453f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c'): ({'sdd'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Removing single pathed devices sdd {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e8c0c0-2378-4dbe-b610-10d5a6a26af8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[966d92b4-e86f-416f-9f12-c1337befb918]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Flushing IO for device /dev/sdd {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f6ca78-8631-424d-ac56-5e0521aa055b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[024cf8c3-57f3-4c17-8a17-a574ae9311d4]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] SCSI volumes sdd have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[95441e8b-9b19-4d79-a1bf-3aeb315f585c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec9b03-0465-4196-b031-8146b8f9e85b]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c, portal: 172.16.0.220,3260]
Aug 01 12:23:27 user nova-compute[72178]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c, portal: 172.16.0.220,3260] successful.
Aug 01 12:23:27 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf2e66a0-5d08-4297-8fa6-812766ddfa8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e6c399-184b-4c49-b1dc-b00c2126666b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] <== disconnect_volume: return (278ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:23:27 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:23:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:28 user nova-compute[72178]: DEBUG nova.objects.instance [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'flavor' on Instance uuid e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:23:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-4aad763f-deeb-4357-9dc8-82b75e5875e4 tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.590s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:33 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892598.2259636, f0ef243f-6c58-4991-97b1-0883d24dd6c9 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:23:33 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] VM Stopped (Lifecycle Event)
Aug 01 12:23:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8d8e24ea-83f1-48f5-975e-d42132bd774d None None] [instance: f0ef243f-6c58-4991-97b1-0883d24dd6c9] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:23:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-53326ea2-070c-4c86-bc31-210791320e2e req-51492f0a-b64a-4b8d-a27d-70d847fbbd1d service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-changed-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-53326ea2-070c-4c86-bc31-210791320e2e req-51492f0a-b64a-4b8d-a27d-70d847fbbd1d service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Refreshing instance network info cache due to event network-changed-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:23:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-53326ea2-070c-4c86-bc31-210791320e2e req-51492f0a-b64a-4b8d-a27d-70d847fbbd1d service nova] Acquiring lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:23:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-53326ea2-070c-4c86-bc31-210791320e2e req-51492f0a-b64a-4b8d-a27d-70d847fbbd1d service nova] Acquired lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:23:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-53326ea2-070c-4c86-bc31-210791320e2e req-51492f0a-b64a-4b8d-a27d-70d847fbbd1d service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Refreshing network info cache for port ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:23:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-53326ea2-070c-4c86-bc31-210791320e2e req-51492f0a-b64a-4b8d-a27d-70d847fbbd1d service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updated VIF entry in instance network info cache for port ff8cbb1b-85e4-406f-aa5f-2efda9e4671f. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:23:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-53326ea2-070c-4c86-bc31-210791320e2e req-51492f0a-b64a-4b8d-a27d-70d847fbbd1d service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updating instance_info_cache with network_info: [{"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-53326ea2-070c-4c86-bc31-210791320e2e req-51492f0a-b64a-4b8d-a27d-70d847fbbd1d service nova] Releasing lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:37 user nova-compute[72178]: INFO nova.compute.manager [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Terminating instance
Aug 01 12:23:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:37 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:37 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Instance destroyed successfully.
Aug 01 12:23:37 user nova-compute[72178]: DEBUG nova.objects.instance [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'resources' on Instance uuid de5dede0-6d6c-489d-8ce0-cd8fcd51f20c {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1225997741',display_name='tempest-TestVolumeBootPattern-server-1225997741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1225997741',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:21:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-0aagkhen',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:21:58Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=de5dede0-6d6c-489d-8ce0-cd8fcd51f20c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:78:18,bridge_name='br-int',has_traffic_filtering=True,id=ff8cbb1b-85e4-406f-aa5f-2efda9e4671f,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8cbb1b-85') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_vif [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:78:18,bridge_name='br-int',has_traffic_filtering=True,id=ff8cbb1b-85e4-406f-aa5f-2efda9e4671f,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8cbb1b-85') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff8cbb1b-85, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:38 user nova-compute[72178]: INFO os_vif [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:78:18,bridge_name='br-int',has_traffic_filtering=True,id=ff8cbb1b-85e4-406f-aa5f-2efda9e4671f,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff8cbb1b-85')
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZVoybLwI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:23:38 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c4bac3-e3b1-47f2-b496-0045ee575377]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9086f84-bd27-487e-9cd7-a444201f770f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:23:38 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:23:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:23:38 user nova-compute[72178]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 (non-flash)
Aug 01 12:23:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f461a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[099ef579-f5db-476b-8f67-7b69ac86c315]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b02972-98a8-40fc-a6fa-322c7c998450]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d280f76c-ee76-4ec8-a5db-bcbc067d1bfa]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc98d7-adfd-4c4d-9046-63402f73234c]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1a0a3-422d-4960-82db-1d16d2443f35]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[33560568-1ea3-4a0a-8005-40fc0a458b8f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8, portal: 172.16.0.220,3260]
Aug 01 12:23:38 user nova-compute[72178]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8, portal: 172.16.0.220,3260] successful.
Aug 01 12:23:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d4bf67-d308-4f11-a840-fb79985677f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8924043-d0e7-408a-8520-3b08c768ec35]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== disconnect_volume: return (294ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:23:38 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Deleting instance files /opt/stack/data/nova/instances/de5dede0-6d6c-489d-8ce0-cd8fcd51f20c_del
Aug 01 12:23:38 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Deletion of /opt/stack/data/nova/instances/de5dede0-6d6c-489d-8ce0-cd8fcd51f20c_del complete
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-changed-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Refreshing instance network info cache due to event network-changed-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Acquiring lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Acquired lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.network.neutron [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Refreshing network info cache for port ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:23:38 user nova-compute[72178]: INFO nova.compute.manager [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 01 12:23:38 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:23:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updated VIF entry in instance network info cache for port ff8cbb1b-85e4-406f-aa5f-2efda9e4671f. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updating instance_info_cache with network_info: [{"id": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "address": "fa:16:3e:99:78:18", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff8cbb1b-85", "ovs_interfaceid": "ff8cbb1b-85e4-406f-aa5f-2efda9e4671f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Releasing lock "refresh_cache-de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-vif-unplugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Acquiring lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] No waiting events found dispatching network-vif-unplugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-vif-unplugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Acquiring lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] No waiting events found dispatching network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:23:39 user nova-compute[72178]: WARNING nova.compute.manager [req-aa9cac78-721b-41d6-8adc-02e7212e0390 req-2d4a7b1f-d544-4f46-addc-79a71ae013ca service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received unexpected event network-vif-plugged-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f for instance with vm_state active and task_state deleting.
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:39 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Took 0.76 seconds to deallocate network for instance.
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-85b0b50c-c7bd-48a2-a923-cd6101bce357 req-90d48bbe-5e53-471f-a4f0-50eef1417b04 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Received event network-vif-deleted-ff8cbb1b-85e4-406f-aa5f-2efda9e4671f {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:39 user nova-compute[72178]: INFO nova.compute.manager [req-85b0b50c-c7bd-48a2-a923-cd6101bce357 req-90d48bbe-5e53-471f-a4f0-50eef1417b04 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Neutron deleted interface ff8cbb1b-85e4-406f-aa5f-2efda9e4671f; detaching it from the instance and deleting it from the info cache
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-85b0b50c-c7bd-48a2-a923-cd6101bce357 req-90d48bbe-5e53-471f-a4f0-50eef1417b04 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-85b0b50c-c7bd-48a2-a923-cd6101bce357 req-90d48bbe-5e53-471f-a4f0-50eef1417b04 service nova] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Detach interface failed, port_id=ff8cbb1b-85e4-406f-aa5f-2efda9e4671f, reason: Instance de5dede0-6d6c-489d-8ce0-cd8fcd51f20c could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892604.8346374, cb59098f-6c2f-4f58-9e83-a3898328625b => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:23:39 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] VM Stopped (Lifecycle Event)
Aug 01 12:23:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-cb2604c9-4e27-47e4-8fe3-b484d71a628b None None] [instance: cb59098f-6c2f-4f58-9e83-a3898328625b] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:23:39 user nova-compute[72178]: INFO nova.compute.manager [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Took 0.78 seconds to detach 1 volumes for instance.
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:40 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:23:40 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:23:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:40 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Deleted allocations for instance de5dede0-6d6c-489d-8ce0-cd8fcd51f20c
Aug 01 12:23:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-a0db33e2-9d7a-4441-b0d5-1dbb2a022094 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "de5dede0-6d6c-489d-8ce0-cd8fcd51f20c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.055s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:23:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:23:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:23:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:23:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updating instance_info_cache with network_info: [{"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:23:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:23:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:23:46 user nova-compute[72178]: INFO nova.compute.claims [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Claim successful on node user
Aug 01 12:23:46 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:23:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:23:46 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.policy [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1158c8ff7efb465d9c7fdb7da7d22045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ca4acce2204173bad928ab3c58d053', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:23:47 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Creating image(s)
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "/opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "/opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "/opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk 1073741824" returned: 0 in 0.057s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Successfully created port: 400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Cannot resize image /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'migration_context' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Ensure instance console log exists: /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Successfully updated port: 400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquired lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-d94c61d3-0fbc-47ea-9a70-0cbfb8b9a0e6 req-87b45a55-dc07-47be-a631-691862c26c6e service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received event network-changed-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.compute.manager [req-d94c61d3-0fbc-47ea-9a70-0cbfb8b9a0e6 req-87b45a55-dc07-47be-a631-691862c26c6e service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Refreshing instance network info cache due to event network-changed-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d94c61d3-0fbc-47ea-9a70-0cbfb8b9a0e6 req-87b45a55-dc07-47be-a631-691862c26c6e service nova] Acquiring lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.neutron [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Updating instance_info_cache with network_info: [{"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Releasing lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Instance network_info: |[{"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d94c61d3-0fbc-47ea-9a70-0cbfb8b9a0e6 req-87b45a55-dc07-47be-a631-691862c26c6e service nova] Acquired lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.neutron [req-d94c61d3-0fbc-47ea-9a70-0cbfb8b9a0e6 req-87b45a55-dc07-47be-a631-691862c26c6e service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Refreshing network info cache for port 400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Start _get_guest_xml network_info=[{"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:23:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:23:48 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-653249112',display_name='tempest-AttachVolumeTestJSON-server-653249112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-653249112',id=49,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtk4Hq3zwji8Bez34HhI7TQ4yFUYC7BNSMtXEr9iL/nQTGvyvQPbi5j+BWlroJI5D5NU9t9b/M5mtkRuub2Rr2JNWkcQ0uOpiKPTx45ouqueHVtmAznPjIk9Bj++qbf9g==',key_name='tempest-keypair-1839975704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-fb89zx1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=00ee6de6-500e-4848-a2b1-5eafc00f4ebb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:59:57,bridge_name='br-int',has_traffic_filtering=True,id=400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400a3b3f-fe') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'pci_devices' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:23:48 user nova-compute[72178]:   <uuid>00ee6de6-500e-4848-a2b1-5eafc00f4ebb</uuid>
Aug 01 12:23:48 user nova-compute[72178]:   <name>instance-00000031</name>
Aug 01 12:23:48 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:23:48 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:23:48 user nova-compute[72178]:   <metadata>
Aug 01 12:23:48 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:23:48 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:23:48 user nova-compute[72178]:       <nova:name>tempest-AttachVolumeTestJSON-server-653249112</nova:name>
Aug 01 12:23:48 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:23:48</nova:creationTime>
Aug 01 12:23:48 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:23:48 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:23:48 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:23:48 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:23:48 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:23:48 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:23:48 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:23:48 user nova-compute[72178]:       <nova:owner>
Aug 01 12:23:48 user nova-compute[72178]:         <nova:user uuid="1158c8ff7efb465d9c7fdb7da7d22045">tempest-AttachVolumeTestJSON-236294761-project-member</nova:user>
Aug 01 12:23:48 user nova-compute[72178]:         <nova:project uuid="c5ca4acce2204173bad928ab3c58d053">tempest-AttachVolumeTestJSON-236294761</nova:project>
Aug 01 12:23:48 user nova-compute[72178]:       </nova:owner>
Aug 01 12:23:48 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:23:48 user nova-compute[72178]:       <nova:ports>
Aug 01 12:23:48 user nova-compute[72178]:         <nova:port uuid="400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed">
Aug 01 12:23:48 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 01 12:23:48 user nova-compute[72178]:         </nova:port>
Aug 01 12:23:48 user nova-compute[72178]:       </nova:ports>
Aug 01 12:23:48 user nova-compute[72178]:     </nova:instance>
Aug 01 12:23:48 user nova-compute[72178]:   </metadata>
Aug 01 12:23:48 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:23:48 user nova-compute[72178]:     <system>
Aug 01 12:23:48 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:23:48 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:23:48 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:23:48 user nova-compute[72178]:       <entry name="serial">00ee6de6-500e-4848-a2b1-5eafc00f4ebb</entry>
Aug 01 12:23:48 user nova-compute[72178]:       <entry name="uuid">00ee6de6-500e-4848-a2b1-5eafc00f4ebb</entry>
Aug 01 12:23:48 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:23:48 user nova-compute[72178]:     </system>
Aug 01 12:23:48 user nova-compute[72178]:   </sysinfo>
Aug 01 12:23:48 user nova-compute[72178]:   <os>
Aug 01 12:23:48 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:23:48 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:23:48 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:23:48 user nova-compute[72178]:   </os>
Aug 01 12:23:48 user nova-compute[72178]:   <features>
Aug 01 12:23:48 user nova-compute[72178]:     <acpi/>
Aug 01 12:23:48 user nova-compute[72178]:     <apic/>
Aug 01 12:23:48 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:23:48 user nova-compute[72178]:   </features>
Aug 01 12:23:48 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:23:48 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:23:48 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:23:48 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:23:48 user nova-compute[72178]:   </clock>
Aug 01 12:23:48 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:23:48 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:23:48 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:23:48 user nova-compute[72178]:   </cpu>
Aug 01 12:23:48 user nova-compute[72178]:   <devices>
Aug 01 12:23:48 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:23:48 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:23:48 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk"/>
Aug 01 12:23:48 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:23:48 user nova-compute[72178]:     </disk>
Aug 01 12:23:48 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:23:48 user nova-compute[72178]:       <mac address="fa:16:3e:b3:59:57"/>
Aug 01 12:23:48 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:23:48 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:23:48 user nova-compute[72178]:       <target dev="tap400a3b3f-fe"/>
Aug 01 12:23:48 user nova-compute[72178]:     </interface>
Aug 01 12:23:48 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:23:48 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/console.log" append="off"/>
Aug 01 12:23:48 user nova-compute[72178]:     </serial>
Aug 01 12:23:48 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:23:48 user nova-compute[72178]:     <video>
Aug 01 12:23:48 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:23:48 user nova-compute[72178]:     </video>
Aug 01 12:23:48 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:23:48 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:23:48 user nova-compute[72178]:     </rng>
Aug 01 12:23:48 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:23:48 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:23:48 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:23:48 user nova-compute[72178]:     </memballoon>
Aug 01 12:23:48 user nova-compute[72178]:   </devices>
Aug 01 12:23:48 user nova-compute[72178]: </domain>
Aug 01 12:23:48 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-653249112',display_name='tempest-AttachVolumeTestJSON-server-653249112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-653249112',id=49,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtk4Hq3zwji8Bez34HhI7TQ4yFUYC7BNSMtXEr9iL/nQTGvyvQPbi5j+BWlroJI5D5NU9t9b/M5mtkRuub2Rr2JNWkcQ0uOpiKPTx45ouqueHVtmAznPjIk9Bj++qbf9g==',key_name='tempest-keypair-1839975704',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-fb89zx1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=00ee6de6-500e-4848-a2b1-5eafc00f4ebb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:59:57,bridge_name='br-int',has_traffic_filtering=True,id=400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400a3b3f-fe') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG os_vif [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:59:57,bridge_name='br-int',has_traffic_filtering=True,id=400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400a3b3f-fe') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap400a3b3f-fe, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap400a3b3f-fe, col_values=(('external_ids', {'iface-id': '400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:59:57', 'vm-uuid': '00ee6de6-500e-4848-a2b1-5eafc00f4ebb'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:48 user nova-compute[72178]: INFO os_vif [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:59:57,bridge_name='br-int',has_traffic_filtering=True,id=400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400a3b3f-fe')
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:23:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No VIF found with MAC fa:16:3e:b3:59:57, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:23:49 user nova-compute[72178]: DEBUG nova.network.neutron [req-d94c61d3-0fbc-47ea-9a70-0cbfb8b9a0e6 req-87b45a55-dc07-47be-a631-691862c26c6e service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Updated VIF entry in instance network info cache for port 400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:23:49 user nova-compute[72178]: DEBUG nova.network.neutron [req-d94c61d3-0fbc-47ea-9a70-0cbfb8b9a0e6 req-87b45a55-dc07-47be-a631-691862c26c6e service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Updating instance_info_cache with network_info: [{"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:23:49 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-d94c61d3-0fbc-47ea-9a70-0cbfb8b9a0e6 req-87b45a55-dc07-47be-a631-691862c26c6e service nova] Releasing lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-781162ab-c7de-42da-9dd0-89f1f939a9e8 req-eacf367c-2c65-43d6-8a3b-9c631ec69cee service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received event network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-781162ab-c7de-42da-9dd0-89f1f939a9e8 req-eacf367c-2c65-43d6-8a3b-9c631ec69cee service nova] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-781162ab-c7de-42da-9dd0-89f1f939a9e8 req-eacf367c-2c65-43d6-8a3b-9c631ec69cee service nova] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-781162ab-c7de-42da-9dd0-89f1f939a9e8 req-eacf367c-2c65-43d6-8a3b-9c631ec69cee service nova] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-781162ab-c7de-42da-9dd0-89f1f939a9e8 req-eacf367c-2c65-43d6-8a3b-9c631ec69cee service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] No waiting events found dispatching network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:23:50 user nova-compute[72178]: WARNING nova.compute.manager [req-781162ab-c7de-42da-9dd0-89f1f939a9e8 req-eacf367c-2c65-43d6-8a3b-9c631ec69cee service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received unexpected event network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed for instance with vm_state building and task_state spawning.
Aug 01 12:23:50 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:23:51 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892632.2889705, 00ee6de6-500e-4848-a2b1-5eafc00f4ebb => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:23:52 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] VM Resumed (Lifecycle Event)
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:23:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Instance spawned successfully.
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:23:52 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:23:52 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8216MB free_disk=25.208152770996094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-3163f1c4-119c-40a8-bddf-3b19d0a55ede req-068dd1f1-d799-4155-9c30-69e68a0f282e service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received event network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3163f1c4-119c-40a8-bddf-3b19d0a55ede req-068dd1f1-d799-4155-9c30-69e68a0f282e service nova] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3163f1c4-119c-40a8-bddf-3b19d0a55ede req-068dd1f1-d799-4155-9c30-69e68a0f282e service nova] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3163f1c4-119c-40a8-bddf-3b19d0a55ede req-068dd1f1-d799-4155-9c30-69e68a0f282e service nova] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-3163f1c4-119c-40a8-bddf-3b19d0a55ede req-068dd1f1-d799-4155-9c30-69e68a0f282e service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] No waiting events found dispatching network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:23:52 user nova-compute[72178]: WARNING nova.compute.manager [req-3163f1c4-119c-40a8-bddf-3b19d0a55ede req-068dd1f1-d799-4155-9c30-69e68a0f282e service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received unexpected event network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed for instance with vm_state building and task_state spawning.
Aug 01 12:23:52 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892632.290738, 00ee6de6-500e-4848-a2b1-5eafc00f4ebb => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:23:52 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] VM Started (Lifecycle Event)
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 051b1b49-f5b2-400d-ac88-b841439743ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 2571d92c-f0c2-4cff-b715-7610cc251145 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:23:52 user nova-compute[72178]: INFO nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Took 5.50 seconds to spawn the instance on the hypervisor.
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:23:52 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:23:52 user nova-compute[72178]: INFO nova.compute.manager [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Took 6.14 seconds to build instance.
Aug 01 12:23:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8ad0bd3c-5df2-414b-a4f3-58ea3aded7ea tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.231s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:23:52 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892617.9886758, de5dede0-6d6c-489d-8ce0-cd8fcd51f20c => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:23:52 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] VM Stopped (Lifecycle Event)
Aug 01 12:23:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-339ef0e0-c5ea-47a4-996c-0f5f6efed06f None None] [instance: de5dede0-6d6c-489d-8ce0-cd8fcd51f20c] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:23:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:23:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:23:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-abf098c5-c760-49e0-ae19-645bf4c4fbba req-1584218b-e45e-4277-93ec-a202686c196d service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received event network-changed-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG nova.compute.manager [req-abf098c5-c760-49e0-ae19-645bf4c4fbba req-1584218b-e45e-4277-93ec-a202686c196d service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Refreshing instance network info cache due to event network-changed-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-abf098c5-c760-49e0-ae19-645bf4c4fbba req-1584218b-e45e-4277-93ec-a202686c196d service nova] Acquiring lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-abf098c5-c760-49e0-ae19-645bf4c4fbba req-1584218b-e45e-4277-93ec-a202686c196d service nova] Acquired lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-abf098c5-c760-49e0-ae19-645bf4c4fbba req-1584218b-e45e-4277-93ec-a202686c196d service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Refreshing network info cache for port ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG nova.objects.instance [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'flavor' on Instance uuid 2571d92c-f0c2-4cff-b715-7610cc251145 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:24:01 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Ignoring supplied device name: /dev/vdb
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:01 user nova-compute[72178]: INFO nova.compute.manager [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Attaching volume 71c0b77c-0dac-46f7-a59b-9eca001a6dbb to /dev/vdb
Aug 01 12:24:01 user nova-compute[72178]: DEBUG os_brick.utils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee89aad-1dac-4f94-895f-d2b13fcd7b6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-abf098c5-c760-49e0-ae19-645bf4c4fbba req-1584218b-e45e-4277-93ec-a202686c196d service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Updated VIF entry in instance network info cache for port ea1c95ce-c5e9-4527-b6ef-8aceea0648a7. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG nova.network.neutron [req-abf098c5-c760-49e0-ae19-645bf4c4fbba req-1584218b-e45e-4277-93ec-a202686c196d service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Updating instance_info_cache with network_info: [{"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-abf098c5-c760-49e0-ae19-645bf4c4fbba req-1584218b-e45e-4277-93ec-a202686c196d service nova] Releasing lock "refresh_cache-2571d92c-f0c2-4cff-b715-7610cc251145" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7e7f7a-227a-4ffe-88bb-effc0d86c5b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f75d92e-cc0f-48e7-978e-cb928e9aef59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdfdeec-033b-4cf0-87d9-9ac38d5722d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:24:01 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:24:01 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35c5ee1-f844-45eb-a689-210913a621ad]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG os_brick.utils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:24:01 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Updating existing volume attachment record: dc1cdfa4-6a26-46af-97b3-98c34eaf634e {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:24:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQNZtUyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:24:08 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:24:08 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:24:08 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb654e0-12a1-414d-b94c-39af2d797170]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:24:08 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0199e1-06d4-4c37-af22-1e9117ea5752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb] added
Aug 01 12:24:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffd03bb-ac65-4824-8baf-940916902ee1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e12efe-27ef-4e66-9eae-2a666f9cbdd1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQNZtUyW {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQNZtUyW" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3a1898-d025-4e44-ba7f-1720e04045a0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQNZtUyW'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[31060d94-6237-460d-be3a-bab669ba0b9c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a96af-8ebc-4842-a93d-d03d6a97e077]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b989e3c4-0535-4a2e-a45a-8cda9e5395ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb, portal: 172.16.0.220,3260]
Aug 01 12:24:08 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb, portal: 172.16.0.220,3260] successful.
Aug 01 12:24:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48a3278-ed8b-4dfb-ae74-7c2b3dba14fe]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93d6eb-aaf5-4111-bf08-a91d0d1ebf8c]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:08 user nova-compute[72178]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb (non-flash)
Aug 01 12:24:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:08 user nova-compute[72178]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb (non-flash)
Aug 01 12:24:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:24:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:09 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:09 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a17d1b1-3019-4502-982a-33357e24d929]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:09 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:24:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQNZtUyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26363303031326330', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363303031326330', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG nova.objects.instance [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'flavor' on Instance uuid 2571d92c-f0c2-4cff-b715-7610cc251145 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:24:10 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:24:10 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:24:10 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:24:10 user nova-compute[72178]:   <serial>71c0b77c-0dac-46f7-a59b-9eca001a6dbb</serial>
Aug 01 12:24:10 user nova-compute[72178]: </disk>
Aug 01 12:24:10 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] No VIF found with MAC fa:16:3e:e4:78:8d, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:24:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-86ce245d-7899-4a4c-80da-4486d718793e tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.055s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:12 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:17 user nova-compute[72178]: INFO nova.compute.manager [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Terminating instance
Aug 01 12:24:17 user nova-compute[72178]: DEBUG nova.compute.manager [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:17 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-8b9b0196-c998-4a3f-815e-be0bd176d673 req-4fc875e8-26e2-461a-80d8-d0edc4c1f19e service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received event network-vif-unplugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8b9b0196-c998-4a3f-815e-be0bd176d673 req-4fc875e8-26e2-461a-80d8-d0edc4c1f19e service nova] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8b9b0196-c998-4a3f-815e-be0bd176d673 req-4fc875e8-26e2-461a-80d8-d0edc4c1f19e service nova] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8b9b0196-c998-4a3f-815e-be0bd176d673 req-4fc875e8-26e2-461a-80d8-d0edc4c1f19e service nova] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-8b9b0196-c998-4a3f-815e-be0bd176d673 req-4fc875e8-26e2-461a-80d8-d0edc4c1f19e service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] No waiting events found dispatching network-vif-unplugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-8b9b0196-c998-4a3f-815e-be0bd176d673 req-4fc875e8-26e2-461a-80d8-d0edc4c1f19e service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received event network-vif-unplugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:24:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Instance destroyed successfully.
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.objects.instance [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lazy-loading 'resources' on Instance uuid e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:21:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1932550499',display_name='tempest-AttachVolumeNegativeTest-server-1932550499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1932550499',id=45,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX2khq7ioCLoBPdaryyMFtx+v3sgADaQ485sQf+RUDSX49CKKph05FbVpWqL3SuA7NDQSLy3PAia5KD8aPoIAUde+igWI3qwqG7rb/2hyHBUdFOP4X2HR7y3G5HPfBaQw==',key_name='tempest-keypair-990035654',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='874d88ce21b743e195c696aaa7195ffc',ramdisk_id='',reservation_id='r-smnlydcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1677263646',owner_user_name='tempest-AttachVolumeNegativeTest-1677263646-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73fd81d3a10a4819a414d5a61a9d6056',uuid=e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converting VIF {"id": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "address": "fa:16:3e:ed:94:bc", "network": {"id": "599941d4-2f77-48d1-8717-ed723784a7ec", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1686149195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "874d88ce21b743e195c696aaa7195ffc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1f6d4f4-e0", "ovs_interfaceid": "f1f6d4f4-e0a4-4122-a499-2b0022a12570", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1f6d4f4-e0a4-4122-a499-2b0022a12570,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f6d4f4-e0') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG os_vif [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1f6d4f4-e0a4-4122-a499-2b0022a12570,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f6d4f4-e0') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1f6d4f4-e0, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:24:18 user nova-compute[72178]: INFO os_vif [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:94:bc,bridge_name='br-int',has_traffic_filtering=True,id=f1f6d4f4-e0a4-4122-a499-2b0022a12570,network=Network(599941d4-2f77-48d1-8717-ed723784a7ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1f6d4f4-e0')
Aug 01 12:24:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Deleting instance files /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb_del
Aug 01 12:24:18 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Deletion of /opt/stack/data/nova/instances/e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb_del complete
Aug 01 12:24:18 user nova-compute[72178]: INFO nova.compute.manager [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 12:24:18 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:24:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:19 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:24:19 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Took 0.84 seconds to deallocate network for instance.
Aug 01 12:24:19 user nova-compute[72178]: DEBUG nova.compute.manager [req-ebc2adb1-f210-4c0c-bfb5-252795684c93 req-205aae33-5226-45c9-a3a2-26b0ab77ceeb service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received event network-vif-deleted-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:19 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:24:19 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:24:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:19 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Deleted allocations for instance e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb
Aug 01 12:24:19 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-22bf15a4-d2e8-4065-857a-e310b397a5ab tempest-AttachVolumeNegativeTest-1677263646 tempest-AttachVolumeNegativeTest-1677263646-project-member] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.209s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-ead8fef5-d868-484d-bb08-bad92d94fe74 req-befc1b41-75cd-4c56-8979-bb940173e312 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received event network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ead8fef5-d868-484d-bb08-bad92d94fe74 req-befc1b41-75cd-4c56-8979-bb940173e312 service nova] Acquiring lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ead8fef5-d868-484d-bb08-bad92d94fe74 req-befc1b41-75cd-4c56-8979-bb940173e312 service nova] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:20 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ead8fef5-d868-484d-bb08-bad92d94fe74 req-befc1b41-75cd-4c56-8979-bb940173e312 service nova] Lock "e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:20 user nova-compute[72178]: DEBUG nova.compute.manager [req-ead8fef5-d868-484d-bb08-bad92d94fe74 req-befc1b41-75cd-4c56-8979-bb940173e312 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] No waiting events found dispatching network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:24:20 user nova-compute[72178]: WARNING nova.compute.manager [req-ead8fef5-d868-484d-bb08-bad92d94fe74 req-befc1b41-75cd-4c56-8979-bb940173e312 service nova] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Received unexpected event network-vif-plugged-f1f6d4f4-e0a4-4122-a499-2b0022a12570 for instance with vm_state deleted and task_state None.
Aug 01 12:24:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:32 user nova-compute[72178]: INFO nova.compute.manager [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Detaching volume 71c0b77c-0dac-46f7-a59b-9eca001a6dbb
Aug 01 12:24:32 user nova-compute[72178]: INFO nova.virt.block_device [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Attempting to driver detach volume 71c0b77c-0dac-46f7-a59b-9eca001a6dbb from mountpoint /dev/vdb
Aug 01 12:24:32 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Attempting to detach device vdb from instance 2571d92c-f0c2-4cff-b715-7610cc251145 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:24:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:24:32 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:24:32 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:24:32 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:24:32 user nova-compute[72178]:   <serial>71c0b77c-0dac-46f7-a59b-9eca001a6dbb</serial>
Aug 01 12:24:32 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:24:32 user nova-compute[72178]: </disk>
Aug 01 12:24:32 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:24:32 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Successfully detached device vdb from instance 2571d92c-f0c2-4cff-b715-7610cc251145 from the persistent domain config.
Aug 01 12:24:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2571d92c-f0c2-4cff-b715-7610cc251145 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:24:32 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:24:32 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:24:32 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:24:32 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:24:32 user nova-compute[72178]:   <serial>71c0b77c-0dac-46f7-a59b-9eca001a6dbb</serial>
Aug 01 12:24:32 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:24:32 user nova-compute[72178]: </disk>
Aug 01 12:24:32 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892673.3482783, 2571d92c-f0c2-4cff-b715-7610cc251145 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2571d92c-f0c2-4cff-b715-7610cc251145 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:24:33 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Successfully detached device vdb from instance 2571d92c-f0c2-4cff-b715-7610cc251145 from the live domain config.
Aug 01 12:24:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQNZtUyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:24:33 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[741720c2-fda9-48c3-851e-fc2a8c8006a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dabc65f-29c9-44c3-9a03-269c351a05fa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:33 user nova-compute[72178]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb (non-flash)
Aug 01 12:24:33 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:33 user nova-compute[72178]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb (non-flash)
Aug 01 12:24:33 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d44d5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892658.4120402, e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:24:33 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] VM Stopped (Lifecycle Event)
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG nova.compute.manager [None req-905ccf24-ec12-4664-84b5-3f9b42c996e9 None None] [instance: e1a2bcd5-cb6b-40c5-b8fc-afef9bccc0bb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b12fe0-fd5e-4f7e-bba3-a3fd415cd19a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c2a61d-18db-4dea-93f1-673649c15884]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18c2c2d-4320-408c-933c-b2c81c7253de]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d1b1a6-fc71-4d35-925e-40c3fb1e52ca]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d07c29-a460-4383-80dc-6a12564e2cb6]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f2bc8f-d18a-42be-845a-2d08cb8fabee]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb, portal: 172.16.0.220,3260]
Aug 01 12:24:33 user nova-compute[72178]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb, portal: 172.16.0.220,3260] successful.
Aug 01 12:24:33 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd38a7-45b3-4a21-a78e-1897aa88aed2]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] <== disconnect_volume: return (305ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:24:33 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'flavor' on Instance uuid 2571d92c-f0c2-4cff-b715-7610cc251145 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2e60c55-7d6d-48b0-aa5c-91524038d1f4 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.578s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:34 user nova-compute[72178]: INFO nova.compute.manager [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Terminating instance
Aug 01 12:24:34 user nova-compute[72178]: DEBUG nova.compute.manager [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-8f28205c-f01f-4c1c-a1cd-b46b5586868e req-69e046a4-6677-49f7-8ce5-4156cd50706e service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received event network-vif-unplugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8f28205c-f01f-4c1c-a1cd-b46b5586868e req-69e046a4-6677-49f7-8ce5-4156cd50706e service nova] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8f28205c-f01f-4c1c-a1cd-b46b5586868e req-69e046a4-6677-49f7-8ce5-4156cd50706e service nova] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8f28205c-f01f-4c1c-a1cd-b46b5586868e req-69e046a4-6677-49f7-8ce5-4156cd50706e service nova] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-8f28205c-f01f-4c1c-a1cd-b46b5586868e req-69e046a4-6677-49f7-8ce5-4156cd50706e service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] No waiting events found dispatching network-vif-unplugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:24:34 user nova-compute[72178]: DEBUG nova.compute.manager [req-8f28205c-f01f-4c1c-a1cd-b46b5586868e req-69e046a4-6677-49f7-8ce5-4156cd50706e service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received event network-vif-unplugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:24:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Instance destroyed successfully.
Aug 01 12:24:35 user nova-compute[72178]: DEBUG nova.objects.instance [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lazy-loading 'resources' on Instance uuid 2571d92c-f0c2-4cff-b715-7610cc251145 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:22:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-714379269',display_name='tempest-VolumesSnapshotTestJSON-instance-714379269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-714379269',id=48,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH++WmGi2brBWHrIOiLTcBOYOxQawHhInI5h58T+PwvGjOTq7FTX/u1TEBEE/FdOaylnRjknSvLldKVyuRz0yCGGcXIQSLAUtIvYyF+DlErw/UcS2Q7z/nTad4x0cf5c5Q==',key_name='tempest-keypair-1921959805',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:22:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3e2397edfe04144b7eaea8d06ceb971',ramdisk_id='',reservation_id='r-ot5kqy04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1949254885',owner_user_name='tempest-VolumesSnapshotTestJSON-1949254885-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='517883471ec747278f78d0329efcccf6',uuid=2571d92c-f0c2-4cff-b715-7610cc251145,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converting VIF {"id": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "address": "fa:16:3e:e4:78:8d", "network": {"id": "7e7b88ad-18ef-4a80-8c3a-9d861f72b660", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1767028184-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3e2397edfe04144b7eaea8d06ceb971", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea1c95ce-c5", "ovs_interfaceid": "ea1c95ce-c5e9-4527-b6ef-8aceea0648a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=ea1c95ce-c5e9-4527-b6ef-8aceea0648a7,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1c95ce-c5') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_vif [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=ea1c95ce-c5e9-4527-b6ef-8aceea0648a7,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1c95ce-c5') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea1c95ce-c5, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:24:35 user nova-compute[72178]: INFO os_vif [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:78:8d,bridge_name='br-int',has_traffic_filtering=True,id=ea1c95ce-c5e9-4527-b6ef-8aceea0648a7,network=Network(7e7b88ad-18ef-4a80-8c3a-9d861f72b660),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea1c95ce-c5')
Aug 01 12:24:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQNZtUyW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:24:35 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71c0b77c-0dac-46f7-a59b-9eca001a6dbb', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[899c1d3f-03ad-4d54-8de6-77e948536577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53d957b-33f5-4683-9bfe-92972c873182]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:35 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f440f0a0>, {}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Disconnecting from: [] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] <== disconnect_volume: return (50ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:24:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Deleting instance files /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145_del
Aug 01 12:24:35 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Deletion of /opt/stack/data/nova/instances/2571d92c-f0c2-4cff-b715-7610cc251145_del complete
Aug 01 12:24:35 user nova-compute[72178]: INFO nova.compute.manager [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 01 12:24:35 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:24:35 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:24:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-dbf4e5eb-49d5-481c-8d25-0f0c1e573aec req-071c0dd6-a855-4b4d-91bd-d26cad80f9af service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received event network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dbf4e5eb-49d5-481c-8d25-0f0c1e573aec req-071c0dd6-a855-4b4d-91bd-d26cad80f9af service nova] Acquiring lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dbf4e5eb-49d5-481c-8d25-0f0c1e573aec req-071c0dd6-a855-4b4d-91bd-d26cad80f9af service nova] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dbf4e5eb-49d5-481c-8d25-0f0c1e573aec req-071c0dd6-a855-4b4d-91bd-d26cad80f9af service nova] Lock "2571d92c-f0c2-4cff-b715-7610cc251145-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-dbf4e5eb-49d5-481c-8d25-0f0c1e573aec req-071c0dd6-a855-4b4d-91bd-d26cad80f9af service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] No waiting events found dispatching network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:24:36 user nova-compute[72178]: WARNING nova.compute.manager [req-dbf4e5eb-49d5-481c-8d25-0f0c1e573aec req-071c0dd6-a855-4b4d-91bd-d26cad80f9af service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received unexpected event network-vif-plugged-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 for instance with vm_state active and task_state deleting.
Aug 01 12:24:37 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:24:37 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Took 1.89 seconds to deallocate network for instance.
Aug 01 12:24:37 user nova-compute[72178]: WARNING nova.volume.cinder [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Attachment dc1cdfa4-6a26-46af-97b3-98c34eaf634e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = dc1cdfa4-6a26-46af-97b3-98c34eaf634e. (HTTP 404) (Request-ID: req-4aea5f65-6be8-499f-9c4b-ffd5f58b12e6)
Aug 01 12:24:37 user nova-compute[72178]: INFO nova.compute.manager [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Took 0.02 seconds to detach 1 volumes for instance.
Aug 01 12:24:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-dec85476-6bbf-412a-843f-4411df820768 req-ab6b6985-5d62-40be-853e-663d032a2267 service nova] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Received event network-vif-deleted-ea1c95ce-c5e9-4527-b6ef-8aceea0648a7 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:37 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:24:37 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:24:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:37 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Deleted allocations for instance 2571d92c-f0c2-4cff-b715-7610cc251145
Aug 01 12:24:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-65431ac6-2ad9-48e9-9d6d-13aad34da095 tempest-VolumesSnapshotTestJSON-1949254885 tempest-VolumesSnapshotTestJSON-1949254885-project-member] Lock "2571d92c-f0c2-4cff-b715-7610cc251145" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.233s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-8b918056-39cc-475d-983b-5a252241b824 req-9b9a1570-7f4d-4b98-9df4-bae23083e926 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-changed-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-8b918056-39cc-475d-983b-5a252241b824 req-9b9a1570-7f4d-4b98-9df4-bae23083e926 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Refreshing instance network info cache due to event network-changed-156e216e-1d49-4a3f-bbc3-a9255430cc36. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8b918056-39cc-475d-983b-5a252241b824 req-9b9a1570-7f4d-4b98-9df4-bae23083e926 service nova] Acquiring lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8b918056-39cc-475d-983b-5a252241b824 req-9b9a1570-7f4d-4b98-9df4-bae23083e926 service nova] Acquired lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-8b918056-39cc-475d-983b-5a252241b824 req-9b9a1570-7f4d-4b98-9df4-bae23083e926 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Refreshing network info cache for port 156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "051b1b49-f5b2-400d-ac88-b841439743ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "051b1b49-f5b2-400d-ac88-b841439743ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:39 user nova-compute[72178]: INFO nova.compute.manager [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Terminating instance
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-400a48b9-8a1e-4a5a-a13b-cad2df341dc7 req-b659cdaa-3897-4cc0-9d35-ca16499bf00d service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-vif-unplugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-400a48b9-8a1e-4a5a-a13b-cad2df341dc7 req-b659cdaa-3897-4cc0-9d35-ca16499bf00d service nova] Acquiring lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-400a48b9-8a1e-4a5a-a13b-cad2df341dc7 req-b659cdaa-3897-4cc0-9d35-ca16499bf00d service nova] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-400a48b9-8a1e-4a5a-a13b-cad2df341dc7 req-b659cdaa-3897-4cc0-9d35-ca16499bf00d service nova] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-400a48b9-8a1e-4a5a-a13b-cad2df341dc7 req-b659cdaa-3897-4cc0-9d35-ca16499bf00d service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] No waiting events found dispatching network-vif-unplugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-400a48b9-8a1e-4a5a-a13b-cad2df341dc7 req-b659cdaa-3897-4cc0-9d35-ca16499bf00d service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-vif-unplugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-8b918056-39cc-475d-983b-5a252241b824 req-9b9a1570-7f4d-4b98-9df4-bae23083e926 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updated VIF entry in instance network info cache for port 156e216e-1d49-4a3f-bbc3-a9255430cc36. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-8b918056-39cc-475d-983b-5a252241b824 req-9b9a1570-7f4d-4b98-9df4-bae23083e926 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updating instance_info_cache with network_info: [{"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-8b918056-39cc-475d-983b-5a252241b824 req-9b9a1570-7f4d-4b98-9df4-bae23083e926 service nova] Releasing lock "refresh_cache-051b1b49-f5b2-400d-ac88-b841439743ee" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Instance destroyed successfully.
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lazy-loading 'resources' on Instance uuid 051b1b49-f5b2-400d-ac88-b841439743ee {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-326278615',display_name='tempest-TestVolumeBootPattern-server-326278615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-326278615',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMA5OqFGwGdzxeLXwJyNSyO98gPLGB3Ja4pXYTu2FUc9bO6/+FSlr8VxnK1WbbllKG3LJQmJsJcz8CV9XVlDP8tf5L6PtXGOM55DYHGe2SmriO8HTLKe6dPHY9JB5zVuQ==',key_name='tempest-TestVolumeBootPattern-1098342254',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:19:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1e0eb9e0006c46dabba55cc95cca217f',ramdisk_id='',reservation_id='r-fuoqcuo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1003407750',owner_user_name='tempest-TestVolumeBootPattern-1003407750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:19:56Z,user_data=None,user_id='ef22394fbdfd4aad8c301596a2ee7b61',uuid=051b1b49-f5b2-400d-ac88-b841439743ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converting VIF {"id": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "address": "fa:16:3e:cf:ee:a7", "network": {"id": "99cf25fe-bb16-478f-a02c-3a5ad7587a6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-733602547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1e0eb9e0006c46dabba55cc95cca217f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap156e216e-1d", "ovs_interfaceid": "156e216e-1d49-4a3f-bbc3-a9255430cc36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:ee:a7,bridge_name='br-int',has_traffic_filtering=True,id=156e216e-1d49-4a3f-bbc3-a9255430cc36,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156e216e-1d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_vif [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:ee:a7,bridge_name='br-int',has_traffic_filtering=True,id=156e216e-1d49-4a3f-bbc3-a9255430cc36,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156e216e-1d') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap156e216e-1d, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:40 user nova-compute[72178]: INFO os_vif [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:ee:a7,bridge_name='br-int',has_traffic_filtering=True,id=156e216e-1d49-4a3f-bbc3-a9255430cc36,network=Network(99cf25fe-bb16-478f-a02c-3a5ad7587a6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap156e216e-1d')
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TDeisuSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:24:40 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a8b7f2-3c8e-4137-a05f-8d13839250c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5c0b59-05ba-4144-a85e-aaf2fcc927a2]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:40 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe (non-flash)
Aug 01 12:24:40 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d459add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe'): ({'sdb'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Removing single pathed devices sdb {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[49451201-d15c-48b9-803d-d728b702c443]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd8929-e1c8-431e-a1cb-b251c2b37c05]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Flushing IO for device /dev/sdb {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d39df-56d5-4635-a407-7bf7bfdd7118]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8d8f24-9df8-448e-a8a0-cdd842d0a7d2]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_e8416fdc', '/dev/disk/by-id/scsi-1SCST_BIOe8416fdc-b50ac2a5c85ea1c3', '/dev/disk/by-id/scsi-26235306163326135') {{(pid=83857) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf63bcb4-fa34-4b9b-9a35-86942b97c413]: (4, None) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[74366c6a-abe7-4d45-8365-12e15daa2c47]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8597fe0e-a204-4288-b199-86cc2558b91c]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260]
Aug 01 12:24:40 user nova-compute[72178]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe, portal: 172.16.0.220,3260] successful.
Aug 01 12:24:40 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03a72a8d-e8ef-4cdc-91ca-fb85f1db7fbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85804ab-a930-4a42-90d0-f12f9212487b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] <== disconnect_volume: return (272ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:24:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Deleting instance files /opt/stack/data/nova/instances/051b1b49-f5b2-400d-ac88-b841439743ee_del
Aug 01 12:24:40 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Deletion of /opt/stack/data/nova/instances/051b1b49-f5b2-400d-ac88-b841439743ee_del complete
Aug 01 12:24:40 user nova-compute[72178]: INFO nova.compute.manager [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 01 12:24:40 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:24:40 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:24:40 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Took 0.59 seconds to deallocate network for instance.
Aug 01 12:24:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-a5aa7558-20ab-4b0f-9c95-3b2452c5d54f req-db5ce2aa-91f7-4556-9fe5-6f1778236fb0 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-vif-deleted-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:41 user nova-compute[72178]: INFO nova.compute.manager [req-a5aa7558-20ab-4b0f-9c95-3b2452c5d54f req-db5ce2aa-91f7-4556-9fe5-6f1778236fb0 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Neutron deleted interface 156e216e-1d49-4a3f-bbc3-a9255430cc36; detaching it from the instance and deleting it from the info cache
Aug 01 12:24:41 user nova-compute[72178]: DEBUG nova.network.neutron [req-a5aa7558-20ab-4b0f-9c95-3b2452c5d54f req-db5ce2aa-91f7-4556-9fe5-6f1778236fb0 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-a5aa7558-20ab-4b0f-9c95-3b2452c5d54f req-db5ce2aa-91f7-4556-9fe5-6f1778236fb0 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Detach interface failed, port_id=156e216e-1d49-4a3f-bbc3-a9255430cc36, reason: Instance 051b1b49-f5b2-400d-ac88-b841439743ee could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:24:41 user nova-compute[72178]: INFO nova.compute.manager [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Took 0.73 seconds to detach 1 volumes for instance.
Aug 01 12:24:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-63143acc-7e5b-4819-acea-00af70ccd5bc req-491d003f-ee26-4dcc-aec1-332dba52c973 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received event network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-63143acc-7e5b-4819-acea-00af70ccd5bc req-491d003f-ee26-4dcc-aec1-332dba52c973 service nova] Acquiring lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-63143acc-7e5b-4819-acea-00af70ccd5bc req-491d003f-ee26-4dcc-aec1-332dba52c973 service nova] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-63143acc-7e5b-4819-acea-00af70ccd5bc req-491d003f-ee26-4dcc-aec1-332dba52c973 service nova] Lock "051b1b49-f5b2-400d-ac88-b841439743ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-63143acc-7e5b-4819-acea-00af70ccd5bc req-491d003f-ee26-4dcc-aec1-332dba52c973 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] No waiting events found dispatching network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:24:41 user nova-compute[72178]: WARNING nova.compute.manager [req-63143acc-7e5b-4819-acea-00af70ccd5bc req-491d003f-ee26-4dcc-aec1-332dba52c973 service nova] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Received unexpected event network-vif-plugged-156e216e-1d49-4a3f-bbc3-a9255430cc36 for instance with vm_state active and task_state deleting.
Aug 01 12:24:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:24:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:42 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Deleted allocations for instance 051b1b49-f5b2-400d-ac88-b841439743ee
Aug 01 12:24:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-e2f30182-83ca-4aeb-b3c3-bf59bbb58a84 tempest-TestVolumeBootPattern-1003407750 tempest-TestVolumeBootPattern-1003407750-project-member] Lock "051b1b49-f5b2-400d-ac88-b841439743ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:42 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:24:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:24:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:24:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:24:42 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updating instance_info_cache with network_info: [{"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:24:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:24:42 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:24:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:24:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:24:50 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892675.281116, 2571d92c-f0c2-4cff-b715-7610cc251145 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:24:50 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] VM Stopped (Lifecycle Event)
Aug 01 12:24:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-e00310b8-71e7-4007-97ce-d3b6504a8fa0 None None] [instance: 2571d92c-f0c2-4cff-b715-7610cc251145] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:24:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:51 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:24:53 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:24:53 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:24:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8419MB free_disk=25.232402801513672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:24:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:24:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:24:55 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892680.0120802, 051b1b49-f5b2-400d-ac88-b841439743ee => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:24:55 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] VM Stopped (Lifecycle Event)
Aug 01 12:24:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-37cdf249-4634-4fbb-85d0-c89865a0fd49 None None] [instance: 051b1b49-f5b2-400d-ac88-b841439743ee] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:24:56 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:24:56 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 12:24:56 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] There are 0 instances to clean {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 12:25:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:25:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:08 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:08 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=72178) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 12:25:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:25:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:25:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:25:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:25:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:11 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:14 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:25:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:25:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:25:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:25:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:25:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:25:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:25:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:25:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:25:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:25:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:25:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:25:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:25:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-4467b9d5-52ad-4b0f-b9e2-2c8a5579b6f5 req-6b912289-7cec-48ac-8ef9-4e14e8308eed service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received event network-changed-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:25:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-4467b9d5-52ad-4b0f-b9e2-2c8a5579b6f5 req-6b912289-7cec-48ac-8ef9-4e14e8308eed service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Refreshing instance network info cache due to event network-changed-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:25:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4467b9d5-52ad-4b0f-b9e2-2c8a5579b6f5 req-6b912289-7cec-48ac-8ef9-4e14e8308eed service nova] Acquiring lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:25:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4467b9d5-52ad-4b0f-b9e2-2c8a5579b6f5 req-6b912289-7cec-48ac-8ef9-4e14e8308eed service nova] Acquired lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:25:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-4467b9d5-52ad-4b0f-b9e2-2c8a5579b6f5 req-6b912289-7cec-48ac-8ef9-4e14e8308eed service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Refreshing network info cache for port 400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:25:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-4467b9d5-52ad-4b0f-b9e2-2c8a5579b6f5 req-6b912289-7cec-48ac-8ef9-4e14e8308eed service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Updated VIF entry in instance network info cache for port 400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:25:39 user nova-compute[72178]: DEBUG nova.network.neutron [req-4467b9d5-52ad-4b0f-b9e2-2c8a5579b6f5 req-6b912289-7cec-48ac-8ef9-4e14e8308eed service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Updating instance_info_cache with network_info: [{"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:25:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4467b9d5-52ad-4b0f-b9e2-2c8a5579b6f5 req-6b912289-7cec-48ac-8ef9-4e14e8308eed service nova] Releasing lock "refresh_cache-00ee6de6-500e-4848-a2b1-5eafc00f4ebb" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:25:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:25:43 user nova-compute[72178]: INFO nova.compute.manager [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Attaching volume 54193c30-a2a0-49b4-8181-3d6df27db43e to /dev/vdb
Aug 01 12:25:43 user nova-compute[72178]: DEBUG os_brick.utils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[96770933-92c7-4323-a0f1-9a19bbb096ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eed7ba-a434-4697-b598-d5b05b796eba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0212daff-fd5c-45b6-b437-72a205edf79a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feff3ac-91cc-455f-994d-589a06dd54f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:25:43 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:25:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e589f375-00cc-4e5c-a233-4eaf5f92413d]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG os_brick.utils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:25:43 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Updating existing volume attachment record: 6c6585c1-9cd2-4016-8f69-1cb242b3a70e {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:25:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_power_states {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 06af0083-dfaa-4649-a993-52a6cc6fef0a {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:25:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Triggering sync for uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 01 12:25:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:25:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:25:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:25:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:25:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:25:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:49 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:51 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pystvZAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:25:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:25:52 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:25:52 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a556ada-7dbe-42f7-80d4-7e6d1648b161]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:25:52 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c84bd80-e883-4661-8668-5bd9464cd781]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e] added
Aug 01 12:25:52 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d286b37-4c7d-4372-aa2c-7ef500ec2f7e]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b0fd6e-6b56-42c9-832a-646dd1f47dcb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pystvZAK {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pystvZAK" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7706c2b8-58b6-412e-b6bb-5f79d6c9f94c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pystvZAK'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d442ac3a-1b7c-4a97-bb52-3e0691fc56a1]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadb2ede-ad09-4c5d-86f5-b01df521e527]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6add7938-9ae4-49fb-b73f-671f73baea3b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d7617d-d97d-4bf0-ad5f-6e8aff7d35eb (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6add7938-9ae4-49fb-b73f-671f73baea3b (non-flash)
Aug 01 12:25:53 user nova-compute[72178]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d7617d-d97d-4bf0-ad5f-6e8aff7d35eb (non-flash)
Aug 01 12:25:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6add7938-9ae4-49fb-b73f-671f73baea3b (non-flash)
Aug 01 12:25:53 user nova-compute[72178]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d7617d-d97d-4bf0-ad5f-6e8aff7d35eb (non-flash)
Aug 01 12:25:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e297b07b-290f-495a-96b6-ab3bd99719ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e, portal: 172.16.0.220,3260]
Aug 01 12:25:53 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e, portal: 172.16.0.220,3260] successful.
Aug 01 12:25:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2a7d6e-e671-4328-ab5d-0eb1e0dca8a8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1593b623-300b-4f82-a567-cefd4a48bd09]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6add7938-9ae4-49fb-b73f-671f73baea3b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d7617d-d97d-4bf0-ad5f-6e8aff7d35eb (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6add7938-9ae4-49fb-b73f-671f73baea3b (non-flash)
Aug 01 12:25:53 user nova-compute[72178]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d7617d-d97d-4bf0-ad5f-6e8aff7d35eb (non-flash)
Aug 01 12:25:53 user nova-compute[72178]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)
Aug 01 12:25:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6add7938-9ae4-49fb-b73f-671f73baea3b (non-flash)
Aug 01 12:25:53 user nova-compute[72178]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0d7617d-d97d-4bf0-ad5f-6e8aff7d35eb (non-flash)
Aug 01 12:25:53 user nova-compute[72178]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)
Aug 01 12:25:53 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.737s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:53 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:25:53 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8486MB free_disk=25.220474243164062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bea89c-679a-4502-8ddb-2476624f3ef7]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: None {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing inventories for resource provider f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Updating ProviderTree inventory for provider f106307e-ff81-42a0-bae9-51f40c919103 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing aggregate associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, aggregates: None {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 12:25:53 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing trait associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdb {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pystvZAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.774s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== connect_volume: return (1776ms) {'type': 'block', 'scsi_wwn': '26361303966626535', 'path': '/dev/sdb'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361303966626535', 'path': '/dev/sdb'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:25:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:25:54 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:25:54 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:25:54 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:25:54 user nova-compute[72178]:   <serial>54193c30-a2a0-49b4-8181-3d6df27db43e</serial>
Aug 01 12:25:54 user nova-compute[72178]: </disk>
Aug 01 12:25:54 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:25:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:25:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:25:55 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No VIF found with MAC fa:16:3e:b3:59:57, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:25:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:25:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-6408110c-eddd-42fe-a5e2-0e2524c62211 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.438s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:25:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.676s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:25:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:25:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:25:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG nova.objects.instance [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:25:59 user nova-compute[72178]: INFO nova.compute.manager [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Attaching volume 1611b17d-fd72-4b39-81dc-d6732a069f78 to /dev/vdc
Aug 01 12:25:59 user nova-compute[72178]: DEBUG os_brick.utils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[894fc891-e1a5-4af7-b73c-df6f4195ddbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9af45f4-8fb0-471b-9b18-daf984eef77c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e65d50-42e2-4c0e-b13e-3c6372ca3970]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[65af3d7b-3122-462d-a6aa-e46f309aa7ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:25:59 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:25:59 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9760480-85a0-4e25-adeb-6ed23387c4b1]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG os_brick.utils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:25:59 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Updating existing volume attachment record: 0e59054e-1b03-46c5-955a-fa45e7f0dbee {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:26:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCwgETuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:26:07 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:26:07 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:26:07 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c1d0f3-c195-4614-8714-c66931ae593f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:26:07 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[63333298-8962-4e51-84bd-2ee96071e785]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78] added
Aug 01 12:26:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b41928-f727-41db-885d-ec1f765d57c4]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[438eb734-14bb-43a6-a8a4-18a977b01853]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCwgETuo {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCwgETuo" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ecc950-9af0-47c9-a4a6-9d4d2583562c]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WCwgETuo'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f431fdc-76e2-4c87-8eda-ff38cc37c7a3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27228da-ff8d-4207-901c-6b44a47f69e1]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)
Aug 01 12:26:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)
Aug 01 12:26:07 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:26:07 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e694356b-3c9a-44a4-8cf8-f0e9be0a82f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78, portal: 172.16.0.220,3260]
Aug 01 12:26:08 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78, portal: 172.16.0.220,3260] successful.
Aug 01 12:26:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefcdcca-f5b8-4fae-90ce-799dc93a555b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38df849-e5a7-4bce-a725-2dd2eae4c844]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)
Aug 01 12:26:08 user nova-compute[72178]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)
Aug 01 12:26:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)
Aug 01 12:26:08 user nova-compute[72178]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)
Aug 01 12:26:08 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51d1246-ebb1-4d06-8df1-88ac44f6f18a]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:26:08 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCwgETuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26337313232376131', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337313232376131', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG nova.objects.instance [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:26:09 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:26:09 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:26:09 user nova-compute[72178]:   <target dev="vdc" bus="virtio"/>
Aug 01 12:26:09 user nova-compute[72178]:   <serial>1611b17d-fd72-4b39-81dc-d6732a069f78</serial>
Aug 01 12:26:09 user nova-compute[72178]: </disk>
Aug 01 12:26:09 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] No VIF found with MAC fa:16:3e:b3:59:57, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:26:09 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-299e25ca-4341-4f02-88e8-3db8a5fbd6fe tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.078s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:26:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:26:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:26:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:26:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:10 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:10 user nova-compute[72178]: INFO nova.compute.manager [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Detaching volume 54193c30-a2a0-49b4-8181-3d6df27db43e
Aug 01 12:26:11 user nova-compute[72178]: INFO nova.virt.block_device [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Attempting to driver detach volume 54193c30-a2a0-49b4-8181-3d6df27db43e from mountpoint /dev/vdb
Aug 01 12:26:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Attempting to detach device vdb from instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:26:11 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:26:11 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:26:11 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:26:11 user nova-compute[72178]:   <serial>54193c30-a2a0-49b4-8181-3d6df27db43e</serial>
Aug 01 12:26:11 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:26:11 user nova-compute[72178]: </disk>
Aug 01 12:26:11 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:26:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully detached device vdb from instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb from the persistent domain config.
Aug 01 12:26:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:26:11 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:26:11 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:26:11 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:26:11 user nova-compute[72178]:   <serial>54193c30-a2a0-49b4-8181-3d6df27db43e</serial>
Aug 01 12:26:11 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:26:11 user nova-compute[72178]: </disk>
Aug 01 12:26:11 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892771.4779446, 00ee6de6-500e-4848-a2b1-5eafc00f4ebb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:26:11 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully detached device vdb from instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb from the live domain config.
Aug 01 12:26:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pystvZAK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:26:11 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e7d82-fc0f-4b8b-95db-a58f39491566]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[978b3cc6-ae05-4ed6-be6c-57e5d7d85a47]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)
Aug 01 12:26:11 user nova-compute[72178]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)
Aug 01 12:26:11 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e (non-flash)
Aug 01 12:26:11 user nova-compute[72178]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)
Aug 01 12:26:11 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8d479e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e'): ({'sdb'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Removing single pathed devices sdb {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c0147a-3f3e-4b14-b205-75a4a0749586]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a206ce24-8f2b-4d05-94b7-1901665fd84d]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flushing IO for device /dev/sdb {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[44427ba1-3247-4a8a-b78a-c7977e705a65]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e72f5a-0cb9-425a-a93a-e9aaae3d7318]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6db616-c057-4b3d-af74-ac92fe0af6af]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[03791c96-bf39-4be8-99d1-5ea692669621]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e, portal: 172.16.0.220,3260]
Aug 01 12:26:11 user nova-compute[72178]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e, portal: 172.16.0.220,3260] successful.
Aug 01 12:26:11 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54193c30-a2a0-49b4-8181-3d6df27db43e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[c014337a-9e72-46ce-ab55-4fa909337d65]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== disconnect_volume: return (286ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:26:11 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:26:12 user nova-compute[72178]: DEBUG nova.objects.instance [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:26:12 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-8aa6e0a4-8493-450b-b69f-5a198ae96dec tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:13 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:13 user nova-compute[72178]: INFO nova.compute.manager [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Detaching volume 1611b17d-fd72-4b39-81dc-d6732a069f78
Aug 01 12:26:13 user nova-compute[72178]: INFO nova.virt.block_device [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Attempting to driver detach volume 1611b17d-fd72-4b39-81dc-d6732a069f78 from mountpoint /dev/vdc
Aug 01 12:26:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Attempting to detach device vdc from instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:26:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:26:13 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:26:13 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:26:13 user nova-compute[72178]:   <target dev="vdc" bus="virtio"/>
Aug 01 12:26:13 user nova-compute[72178]:   <serial>1611b17d-fd72-4b39-81dc-d6732a069f78</serial>
Aug 01 12:26:13 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 12:26:13 user nova-compute[72178]: </disk>
Aug 01 12:26:13 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:26:13 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully detached device vdc from instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb from the persistent domain config.
Aug 01 12:26:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:26:13 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:26:13 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:26:13 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:26:13 user nova-compute[72178]:   <target dev="vdc" bus="virtio"/>
Aug 01 12:26:13 user nova-compute[72178]:   <serial>1611b17d-fd72-4b39-81dc-d6732a069f78</serial>
Aug 01 12:26:13 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 12:26:13 user nova-compute[72178]: </disk>
Aug 01 12:26:13 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:26:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892774.016105, 00ee6de6-500e-4848-a2b1-5eafc00f4ebb => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:26:14 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully detached device vdc from instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb from the live domain config.
Aug 01 12:26:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCwgETuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:26:14 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f6e728-05ff-44e4-bbce-433b50551c91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a7cf89-be9b-4749-ba16-aa97cb35ba5c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)
Aug 01 12:26:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 (non-flash)
Aug 01 12:26:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040d1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[490ca68e-3a30-46e4-b2a0-611fa69f7534]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[74755e01-a9ab-4ec0-877b-be9dda0fec24]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7886931c-eb93-4b57-9c80-bfb9c93cab39]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[554e8db2-6c0b-4888-93e3-b132525958a7]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ad1052-e274-4083-97b5-fe0e66c14852]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e0ac03-4220-4418-8769-1c578f2ac343]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78, portal: 172.16.0.220,3260]
Aug 01 12:26:14 user nova-compute[72178]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78, portal: 172.16.0.220,3260] successful.
Aug 01 12:26:14 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1611b17d-fd72-4b39-81dc-d6732a069f78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[444624f5-c2a5-44ec-bb25-733202494eeb]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] <== disconnect_volume: return (274ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:26:14 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:26:15 user nova-compute[72178]: DEBUG nova.objects.instance [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'flavor' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:26:15 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-91670e8b-c754-4c2a-ba5d-2189e2f7da39 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.626s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:16 user nova-compute[72178]: INFO nova.compute.manager [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Terminating instance
Aug 01 12:26:16 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-e8b7dd38-bd30-4c94-8752-9348a4353a48 req-65afb450-57b4-410d-8d4a-f1e2fbdc4f1a service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received event network-vif-unplugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e8b7dd38-bd30-4c94-8752-9348a4353a48 req-65afb450-57b4-410d-8d4a-f1e2fbdc4f1a service nova] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e8b7dd38-bd30-4c94-8752-9348a4353a48 req-65afb450-57b4-410d-8d4a-f1e2fbdc4f1a service nova] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e8b7dd38-bd30-4c94-8752-9348a4353a48 req-65afb450-57b4-410d-8d4a-f1e2fbdc4f1a service nova] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-e8b7dd38-bd30-4c94-8752-9348a4353a48 req-65afb450-57b4-410d-8d4a-f1e2fbdc4f1a service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] No waiting events found dispatching network-vif-unplugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG nova.compute.manager [req-e8b7dd38-bd30-4c94-8752-9348a4353a48 req-65afb450-57b4-410d-8d4a-f1e2fbdc4f1a service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received event network-vif-unplugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Instance destroyed successfully.
Aug 01 12:26:16 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lazy-loading 'resources' on Instance uuid 00ee6de6-500e-4848-a2b1-5eafc00f4ebb {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:23:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-653249112',display_name='tempest-AttachVolumeTestJSON-server-653249112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-653249112',id=49,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtk4Hq3zwji8Bez34HhI7TQ4yFUYC7BNSMtXEr9iL/nQTGvyvQPbi5j+BWlroJI5D5NU9t9b/M5mtkRuub2Rr2JNWkcQ0uOpiKPTx45ouqueHVtmAznPjIk9Bj++qbf9g==',key_name='tempest-keypair-1839975704',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5ca4acce2204173bad928ab3c58d053',ramdisk_id='',reservation_id='r-fb89zx1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-236294761',owner_user_name='tempest-AttachVolumeTestJSON-236294761-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1158c8ff7efb465d9c7fdb7da7d22045',uuid=00ee6de6-500e-4848-a2b1-5eafc00f4ebb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converting VIF {"id": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "address": "fa:16:3e:b3:59:57", "network": {"id": "18b8c385-4bec-44cc-b8e5-ccc94b0533ff", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-454173964-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5ca4acce2204173bad928ab3c58d053", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap400a3b3f-fe", "ovs_interfaceid": "400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:59:57,bridge_name='br-int',has_traffic_filtering=True,id=400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400a3b3f-fe') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG os_vif [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:59:57,bridge_name='br-int',has_traffic_filtering=True,id=400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400a3b3f-fe') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap400a3b3f-fe, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:26:16 user nova-compute[72178]: INFO os_vif [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:59:57,bridge_name='br-int',has_traffic_filtering=True,id=400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed,network=Network(18b8c385-4bec-44cc-b8e5-ccc94b0533ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap400a3b3f-fe')
Aug 01 12:26:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Deleting instance files /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb_del
Aug 01 12:26:16 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Deletion of /opt/stack/data/nova/instances/00ee6de6-500e-4848-a2b1-5eafc00f4ebb_del complete
Aug 01 12:26:17 user nova-compute[72178]: INFO nova.compute.manager [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 01 12:26:17 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:26:17 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:26:17 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:26:18 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Took 1.41 seconds to deallocate network for instance.
Aug 01 12:26:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-1aa4305b-faa6-4f2c-8519-d9acf6f903a2 req-18b7eaf8-12e3-4540-86b1-c3352cd9005a service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received event network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1aa4305b-faa6-4f2c-8519-d9acf6f903a2 req-18b7eaf8-12e3-4540-86b1-c3352cd9005a service nova] Acquiring lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1aa4305b-faa6-4f2c-8519-d9acf6f903a2 req-18b7eaf8-12e3-4540-86b1-c3352cd9005a service nova] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-1aa4305b-faa6-4f2c-8519-d9acf6f903a2 req-18b7eaf8-12e3-4540-86b1-c3352cd9005a service nova] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-1aa4305b-faa6-4f2c-8519-d9acf6f903a2 req-18b7eaf8-12e3-4540-86b1-c3352cd9005a service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] No waiting events found dispatching network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:26:18 user nova-compute[72178]: WARNING nova.compute.manager [req-1aa4305b-faa6-4f2c-8519-d9acf6f903a2 req-18b7eaf8-12e3-4540-86b1-c3352cd9005a service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received unexpected event network-vif-plugged-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed for instance with vm_state active and task_state deleting.
Aug 01 12:26:18 user nova-compute[72178]: DEBUG nova.compute.manager [req-1aa4305b-faa6-4f2c-8519-d9acf6f903a2 req-18b7eaf8-12e3-4540-86b1-c3352cd9005a service nova] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Received event network-vif-deleted-400a3b3f-fe3f-4a96-bbb3-19b0cdf495ed {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:26:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:18 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Deleted allocations for instance 00ee6de6-500e-4848-a2b1-5eafc00f4ebb
Aug 01 12:26:18 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bc19d8b8-1dbd-4b72-8844-a6828c448925 tempest-AttachVolumeTestJSON-236294761 tempest-AttachVolumeTestJSON-236294761-project-member] Lock "00ee6de6-500e-4848-a2b1-5eafc00f4ebb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.779s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:22 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:31 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892776.9171357, 00ee6de6-500e-4848-a2b1-5eafc00f4ebb => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:26:31 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] VM Stopped (Lifecycle Event)
Aug 01 12:26:31 user nova-compute[72178]: DEBUG nova.compute.manager [None req-356cd6a6-00f8-4286-82d9-b9d42ff1522a None None] [instance: 00ee6de6-500e-4848-a2b1-5eafc00f4ebb] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:26:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:37 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:26:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:26:38 user nova-compute[72178]: INFO nova.compute.claims [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Claim successful on node user
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:26:38 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.policy [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8046155edc9b47399c32a5500a3bbbe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edeead892fa74272a53c42518d046895', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:26:38 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Creating image(s)
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "/opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "/opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "/opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.138s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk 1073741824" returned: 0 in 0.052s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:26:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Successfully created port: 0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Cannot resize image /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'migration_context' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Ensure instance console log exists: /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Successfully updated port: 0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquired lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-dbfa6a9e-921c-4e79-bbf4-72d55731c2cb req-4f79cbc0-4b24-4fef-9307-fcbfcb6e1925 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received event network-changed-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-dbfa6a9e-921c-4e79-bbf4-72d55731c2cb req-4f79cbc0-4b24-4fef-9307-fcbfcb6e1925 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Refreshing instance network info cache due to event network-changed-0c709738-7bf8-42aa-9c33-517ebbc08bdf. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dbfa6a9e-921c-4e79-bbf4-72d55731c2cb req-4f79cbc0-4b24-4fef-9307-fcbfcb6e1925 service nova] Acquiring lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.neutron [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating instance_info_cache with network_info: [{"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Releasing lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Instance network_info: |[{"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dbfa6a9e-921c-4e79-bbf4-72d55731c2cb req-4f79cbc0-4b24-4fef-9307-fcbfcb6e1925 service nova] Acquired lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.neutron [req-dbfa6a9e-921c-4e79-bbf4-72d55731c2cb req-4f79cbc0-4b24-4fef-9307-fcbfcb6e1925 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Refreshing network info cache for port 0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Start _get_guest_xml network_info=[{"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:26:40 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:26:40 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1938002166',display_name='tempest-TestServerVolumeAttachmentScenario-server-1938002166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1938002166',id=50,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7GrlcHqLDlxZYTX4j7/8MJDQuhJWakB4hVrjzj4qBZDO9DZu9ZSi1WsbWczuBNRU62eOxUivBuLd0koqBFukMFmyI+lEE/T0TQ1yCkuMYsUldVIU402F1wWpS8F5TYg==',key_name='tempest-keypair-308692096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edeead892fa74272a53c42518d046895',ramdisk_id='',reservation_id='r-ongike9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-500706763',owner_user_name='tempest-TestServerVolumeAttachmentScenario-500706763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8046155edc9b47399c32a5500a3bbbe5',uuid=f90d35dc-6b1b-4c80-a122-ae132c9b32a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Converting VIF {"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:97:83,bridge_name='br-int',has_traffic_filtering=True,id=0c709738-7bf8-42aa-9c33-517ebbc08bdf,network=Network(f5c7de12-5486-4aed-8441-e6aabd7e921d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c709738-7b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.objects.instance [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'pci_devices' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:26:40 user nova-compute[72178]:   <uuid>f90d35dc-6b1b-4c80-a122-ae132c9b32a0</uuid>
Aug 01 12:26:40 user nova-compute[72178]:   <name>instance-00000032</name>
Aug 01 12:26:40 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:26:40 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:26:40 user nova-compute[72178]:   <metadata>
Aug 01 12:26:40 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:26:40 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:26:40 user nova-compute[72178]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1938002166</nova:name>
Aug 01 12:26:40 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:26:40</nova:creationTime>
Aug 01 12:26:40 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:26:40 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:26:40 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:26:40 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:26:40 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:26:40 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:26:40 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:26:40 user nova-compute[72178]:       <nova:owner>
Aug 01 12:26:40 user nova-compute[72178]:         <nova:user uuid="8046155edc9b47399c32a5500a3bbbe5">tempest-TestServerVolumeAttachmentScenario-500706763-project-member</nova:user>
Aug 01 12:26:40 user nova-compute[72178]:         <nova:project uuid="edeead892fa74272a53c42518d046895">tempest-TestServerVolumeAttachmentScenario-500706763</nova:project>
Aug 01 12:26:40 user nova-compute[72178]:       </nova:owner>
Aug 01 12:26:40 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:26:40 user nova-compute[72178]:       <nova:ports>
Aug 01 12:26:40 user nova-compute[72178]:         <nova:port uuid="0c709738-7bf8-42aa-9c33-517ebbc08bdf">
Aug 01 12:26:40 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 01 12:26:40 user nova-compute[72178]:         </nova:port>
Aug 01 12:26:40 user nova-compute[72178]:       </nova:ports>
Aug 01 12:26:40 user nova-compute[72178]:     </nova:instance>
Aug 01 12:26:40 user nova-compute[72178]:   </metadata>
Aug 01 12:26:40 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:26:40 user nova-compute[72178]:     <system>
Aug 01 12:26:40 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:26:40 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:26:40 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:26:40 user nova-compute[72178]:       <entry name="serial">f90d35dc-6b1b-4c80-a122-ae132c9b32a0</entry>
Aug 01 12:26:40 user nova-compute[72178]:       <entry name="uuid">f90d35dc-6b1b-4c80-a122-ae132c9b32a0</entry>
Aug 01 12:26:40 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:26:40 user nova-compute[72178]:     </system>
Aug 01 12:26:40 user nova-compute[72178]:   </sysinfo>
Aug 01 12:26:40 user nova-compute[72178]:   <os>
Aug 01 12:26:40 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:26:40 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:26:40 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:26:40 user nova-compute[72178]:   </os>
Aug 01 12:26:40 user nova-compute[72178]:   <features>
Aug 01 12:26:40 user nova-compute[72178]:     <acpi/>
Aug 01 12:26:40 user nova-compute[72178]:     <apic/>
Aug 01 12:26:40 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:26:40 user nova-compute[72178]:   </features>
Aug 01 12:26:40 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:26:40 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:26:40 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:26:40 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:26:40 user nova-compute[72178]:   </clock>
Aug 01 12:26:40 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:26:40 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:26:40 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:26:40 user nova-compute[72178]:   </cpu>
Aug 01 12:26:40 user nova-compute[72178]:   <devices>
Aug 01 12:26:40 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:26:40 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:26:40 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk"/>
Aug 01 12:26:40 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:26:40 user nova-compute[72178]:     </disk>
Aug 01 12:26:40 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:26:40 user nova-compute[72178]:       <mac address="fa:16:3e:0b:97:83"/>
Aug 01 12:26:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:26:40 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:26:40 user nova-compute[72178]:       <target dev="tap0c709738-7b"/>
Aug 01 12:26:40 user nova-compute[72178]:     </interface>
Aug 01 12:26:40 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:26:40 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/console.log" append="off"/>
Aug 01 12:26:40 user nova-compute[72178]:     </serial>
Aug 01 12:26:40 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:26:40 user nova-compute[72178]:     <video>
Aug 01 12:26:40 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:26:40 user nova-compute[72178]:     </video>
Aug 01 12:26:40 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:26:40 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:26:40 user nova-compute[72178]:     </rng>
Aug 01 12:26:40 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:26:40 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:26:40 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:26:40 user nova-compute[72178]:     </memballoon>
Aug 01 12:26:40 user nova-compute[72178]:   </devices>
Aug 01 12:26:40 user nova-compute[72178]: </domain>
Aug 01 12:26:40 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1938002166',display_name='tempest-TestServerVolumeAttachmentScenario-server-1938002166',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1938002166',id=50,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7GrlcHqLDlxZYTX4j7/8MJDQuhJWakB4hVrjzj4qBZDO9DZu9ZSi1WsbWczuBNRU62eOxUivBuLd0koqBFukMFmyI+lEE/T0TQ1yCkuMYsUldVIU402F1wWpS8F5TYg==',key_name='tempest-keypair-308692096',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edeead892fa74272a53c42518d046895',ramdisk_id='',reservation_id='r-ongike9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-500706763',owner_user_name='tempest-TestServerVolumeAttachmentScenario-500706763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8046155edc9b47399c32a5500a3bbbe5',uuid=f90d35dc-6b1b-4c80-a122-ae132c9b32a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Converting VIF {"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:97:83,bridge_name='br-int',has_traffic_filtering=True,id=0c709738-7bf8-42aa-9c33-517ebbc08bdf,network=Network(f5c7de12-5486-4aed-8441-e6aabd7e921d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c709738-7b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG os_vif [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:97:83,bridge_name='br-int',has_traffic_filtering=True,id=0c709738-7bf8-42aa-9c33-517ebbc08bdf,network=Network(f5c7de12-5486-4aed-8441-e6aabd7e921d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c709738-7b') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c709738-7b, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c709738-7b, col_values=(('external_ids', {'iface-id': '0c709738-7bf8-42aa-9c33-517ebbc08bdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:97:83', 'vm-uuid': 'f90d35dc-6b1b-4c80-a122-ae132c9b32a0'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:40 user nova-compute[72178]: INFO os_vif [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:97:83,bridge_name='br-int',has_traffic_filtering=True,id=0c709738-7bf8-42aa-9c33-517ebbc08bdf,network=Network(f5c7de12-5486-4aed-8441-e6aabd7e921d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c709738-7b')
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:26:40 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No VIF found with MAC fa:16:3e:0b:97:83, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:26:41 user nova-compute[72178]: DEBUG nova.network.neutron [req-dbfa6a9e-921c-4e79-bbf4-72d55731c2cb req-4f79cbc0-4b24-4fef-9307-fcbfcb6e1925 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updated VIF entry in instance network info cache for port 0c709738-7bf8-42aa-9c33-517ebbc08bdf. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:26:41 user nova-compute[72178]: DEBUG nova.network.neutron [req-dbfa6a9e-921c-4e79-bbf4-72d55731c2cb req-4f79cbc0-4b24-4fef-9307-fcbfcb6e1925 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating instance_info_cache with network_info: [{"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:26:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-dbfa6a9e-921c-4e79-bbf4-72d55731c2cb req-4f79cbc0-4b24-4fef-9307-fcbfcb6e1925 service nova] Releasing lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e839bf2-25c9-4cfa-a4ba-1e62b23626f0 req-92e1c63d-9e68-4602-8545-c40b6ee08c74 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received event network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e839bf2-25c9-4cfa-a4ba-1e62b23626f0 req-92e1c63d-9e68-4602-8545-c40b6ee08c74 service nova] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e839bf2-25c9-4cfa-a4ba-1e62b23626f0 req-92e1c63d-9e68-4602-8545-c40b6ee08c74 service nova] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3e839bf2-25c9-4cfa-a4ba-1e62b23626f0 req-92e1c63d-9e68-4602-8545-c40b6ee08c74 service nova] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG nova.compute.manager [req-3e839bf2-25c9-4cfa-a4ba-1e62b23626f0 req-92e1c63d-9e68-4602-8545-c40b6ee08c74 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] No waiting events found dispatching network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:26:42 user nova-compute[72178]: WARNING nova.compute.manager [req-3e839bf2-25c9-4cfa-a4ba-1e62b23626f0 req-92e1c63d-9e68-4602-8545-c40b6ee08c74 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received unexpected event network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf for instance with vm_state building and task_state spawning.
Aug 01 12:26:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892804.1762934, f90d35dc-6b1b-4c80-a122-ae132c9b32a0 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:26:44 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] VM Resumed (Lifecycle Event)
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:26:44 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Instance spawned successfully.
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:26:44 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892804.1805048, f90d35dc-6b1b-4c80-a122-ae132c9b32a0 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:26:44 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] VM Started (Lifecycle Event)
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:26:44 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:26:44 user nova-compute[72178]: INFO nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:26:44 user nova-compute[72178]: INFO nova.compute.manager [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Took 6.43 seconds to build instance.
Aug 01 12:26:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-bcefe0df-06c0-467c-a892-f0f5a86b14b0 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.560s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid 06af0083-dfaa-4649-a993-52a6cc6fef0a {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-2039a258-6535-4f99-9cd4-e30c94acd07d req-bc760140-609e-4e7e-ba2d-2b8a9ff6e4ec service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received event network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2039a258-6535-4f99-9cd4-e30c94acd07d req-bc760140-609e-4e7e-ba2d-2b8a9ff6e4ec service nova] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2039a258-6535-4f99-9cd4-e30c94acd07d req-bc760140-609e-4e7e-ba2d-2b8a9ff6e4ec service nova] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-2039a258-6535-4f99-9cd4-e30c94acd07d req-bc760140-609e-4e7e-ba2d-2b8a9ff6e4ec service nova] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [req-2039a258-6535-4f99-9cd4-e30c94acd07d req-bc760140-609e-4e7e-ba2d-2b8a9ff6e4ec service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] No waiting events found dispatching network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:26:44 user nova-compute[72178]: WARNING nova.compute.manager [req-2039a258-6535-4f99-9cd4-e30c94acd07d req-bc760140-609e-4e7e-ba2d-2b8a9ff6e4ec service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received unexpected event network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf for instance with vm_state active and task_state None.
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updating instance_info_cache with network_info: [{"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-06af0083-dfaa-4649-a993-52a6cc6fef0a" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:26:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:26:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:49 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:49 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:26:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:26:52 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:26:55 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:26:55 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:26:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8520MB free_disk=25.233802795410156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:26:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:26:57 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:26:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:08 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:27:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:27:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:27:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:27:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:27:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:27:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:27:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:44 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:27:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:27:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:27:44 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:27:44 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating instance_info_cache with network_info: [{"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:27:44 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:27:44 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:27:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:27:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:27:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:27:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:27:55 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:27:55 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:27:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8649MB free_disk=25.20351791381836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:27:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:28:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:28:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:28:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:28:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:28:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:28:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:28:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:28:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:28:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:28:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:28:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:28:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:28:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:28:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:28:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:28 user nova-compute[72178]: DEBUG nova.compute.manager [req-ccaba5f1-b440-4161-bf0b-b422399902ea req-b22fb2e0-93fb-4acb-b41f-6b7da1145295 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received event network-changed-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:28:28 user nova-compute[72178]: DEBUG nova.compute.manager [req-ccaba5f1-b440-4161-bf0b-b422399902ea req-b22fb2e0-93fb-4acb-b41f-6b7da1145295 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Refreshing instance network info cache due to event network-changed-0c709738-7bf8-42aa-9c33-517ebbc08bdf. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:28:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ccaba5f1-b440-4161-bf0b-b422399902ea req-b22fb2e0-93fb-4acb-b41f-6b7da1145295 service nova] Acquiring lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:28:28 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ccaba5f1-b440-4161-bf0b-b422399902ea req-b22fb2e0-93fb-4acb-b41f-6b7da1145295 service nova] Acquired lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:28:28 user nova-compute[72178]: DEBUG nova.network.neutron [req-ccaba5f1-b440-4161-bf0b-b422399902ea req-b22fb2e0-93fb-4acb-b41f-6b7da1145295 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Refreshing network info cache for port 0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:28:29 user nova-compute[72178]: DEBUG nova.network.neutron [req-ccaba5f1-b440-4161-bf0b-b422399902ea req-b22fb2e0-93fb-4acb-b41f-6b7da1145295 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updated VIF entry in instance network info cache for port 0c709738-7bf8-42aa-9c33-517ebbc08bdf. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:28:29 user nova-compute[72178]: DEBUG nova.network.neutron [req-ccaba5f1-b440-4161-bf0b-b422399902ea req-b22fb2e0-93fb-4acb-b41f-6b7da1145295 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating instance_info_cache with network_info: [{"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:28:29 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-ccaba5f1-b440-4161-bf0b-b422399902ea req-b22fb2e0-93fb-4acb-b41f-6b7da1145295 service nova] Releasing lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'flavor' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:30 user nova-compute[72178]: INFO nova.compute.manager [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Attaching volume ec2de807-b8ab-44d6-adca-bf9d630a3c42 to /dev/vdb
Aug 01 12:28:30 user nova-compute[72178]: DEBUG os_brick.utils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2d72f5-51d0-4797-a2b2-bed226b26e47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab6763e-6169-4cea-9a62-85d40d118d1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d62610-001e-4115-a0c7-3b2129e088b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb570a79-b740-4fe9-a832-a4ccc353b860]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:28:30 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:28:30 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8431ab2-1a05-470d-8dcc-84e586492eb1]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG os_brick.utils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:28:30 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating existing volume attachment record: 55e01a35-3a5e-4e18-ae90-992b3463af12 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:28:33 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:35 user nova-compute[72178]: INFO nova.compute.manager [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Terminating instance
Aug 01 12:28:35 user nova-compute[72178]: DEBUG nova.compute.manager [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-e2295d93-58e7-43f7-8d97-b900cd02c307 req-7d3432fe-da83-47b4-9b23-e12daf46d6f3 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received event network-vif-unplugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e2295d93-58e7-43f7-8d97-b900cd02c307 req-7d3432fe-da83-47b4-9b23-e12daf46d6f3 service nova] Acquiring lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e2295d93-58e7-43f7-8d97-b900cd02c307 req-7d3432fe-da83-47b4-9b23-e12daf46d6f3 service nova] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e2295d93-58e7-43f7-8d97-b900cd02c307 req-7d3432fe-da83-47b4-9b23-e12daf46d6f3 service nova] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-e2295d93-58e7-43f7-8d97-b900cd02c307 req-7d3432fe-da83-47b4-9b23-e12daf46d6f3 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] No waiting events found dispatching network-vif-unplugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG nova.compute.manager [req-e2295d93-58e7-43f7-8d97-b900cd02c307 req-7d3432fe-da83-47b4-9b23-e12daf46d6f3 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received event network-vif-unplugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:28:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Instance destroyed successfully.
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.objects.instance [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lazy-loading 'resources' on Instance uuid 06af0083-dfaa-4649-a993-52a6cc6fef0a {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:19:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1665880290',display_name='tempest-ServersNegativeTestJSON-server-1665880290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1665880290',id=44,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:19:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5744024985c24187a2add045778a28df',ramdisk_id='',reservation_id='r-aekcdn91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1559526557',owner_user_name='tempest-ServersNegativeTestJSON-1559526557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:19:50Z,user_data=None,user_id='923afe9bd6654c02b9a2dc0d2c7aacd9',uuid=06af0083-dfaa-4649-a993-52a6cc6fef0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converting VIF {"id": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "address": "fa:16:3e:2c:23:bc", "network": {"id": "b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-112047203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5744024985c24187a2add045778a28df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f526db4-0d", "ovs_interfaceid": "2f526db4-0d51-4030-9fc7-7c4f6dfdd014", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:23:bc,bridge_name='br-int',has_traffic_filtering=True,id=2f526db4-0d51-4030-9fc7-7c4f6dfdd014,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f526db4-0d') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG os_vif [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:23:bc,bridge_name='br-int',has_traffic_filtering=True,id=2f526db4-0d51-4030-9fc7-7c4f6dfdd014,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f526db4-0d') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f526db4-0d, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:28:36 user nova-compute[72178]: INFO os_vif [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:23:bc,bridge_name='br-int',has_traffic_filtering=True,id=2f526db4-0d51-4030-9fc7-7c4f6dfdd014,network=Network(b5fc89ac-a9cc-4c2a-af26-1e1b7373f68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f526db4-0d')
Aug 01 12:28:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Deleting instance files /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a_del
Aug 01 12:28:36 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Deletion of /opt/stack/data/nova/instances/06af0083-dfaa-4649-a993-52a6cc6fef0a_del complete
Aug 01 12:28:36 user nova-compute[72178]: INFO nova.compute.manager [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 01 12:28:36 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:28:36 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Took 0.53 seconds to deallocate network for instance.
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-40d26da5-5ff6-4cc6-956f-d01f30c13e2c req-1a53fc4b-4ae8-4d20-b242-54d2c8c3251f service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received event network-vif-deleted-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:28:36 user nova-compute[72178]: INFO nova.compute.manager [req-40d26da5-5ff6-4cc6-956f-d01f30c13e2c req-1a53fc4b-4ae8-4d20-b242-54d2c8c3251f service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Neutron deleted interface 2f526db4-0d51-4030-9fc7-7c4f6dfdd014; detaching it from the instance and deleting it from the info cache
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.network.neutron [req-40d26da5-5ff6-4cc6-956f-d01f30c13e2c req-1a53fc4b-4ae8-4d20-b242-54d2c8c3251f service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG nova.compute.manager [req-40d26da5-5ff6-4cc6-956f-d01f30c13e2c req-1a53fc4b-4ae8-4d20-b242-54d2c8c3251f service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Detach interface failed, port_id=2f526db4-0d51-4030-9fc7-7c4f6dfdd014, reason: Instance 06af0083-dfaa-4649-a993-52a6cc6fef0a could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:36 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:37 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:28:37 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:28:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:37 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Deleted allocations for instance 06af0083-dfaa-4649-a993-52a6cc6fef0a
Aug 01 12:28:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-176bf924-85f2-4edc-8d60-57b2cde63868 tempest-ServersNegativeTestJSON-1559526557 tempest-ServersNegativeTestJSON-1559526557-project-member] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.790s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-363f402b-1279-4a7e-9ea7-921ee23fa826 req-5cb2145b-ac0f-4346-a986-dc09e4e8e773 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received event network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:28:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-363f402b-1279-4a7e-9ea7-921ee23fa826 req-5cb2145b-ac0f-4346-a986-dc09e4e8e773 service nova] Acquiring lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-363f402b-1279-4a7e-9ea7-921ee23fa826 req-5cb2145b-ac0f-4346-a986-dc09e4e8e773 service nova] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:37 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-363f402b-1279-4a7e-9ea7-921ee23fa826 req-5cb2145b-ac0f-4346-a986-dc09e4e8e773 service nova] Lock "06af0083-dfaa-4649-a993-52a6cc6fef0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:37 user nova-compute[72178]: DEBUG nova.compute.manager [req-363f402b-1279-4a7e-9ea7-921ee23fa826 req-5cb2145b-ac0f-4346-a986-dc09e4e8e773 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] No waiting events found dispatching network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:28:37 user nova-compute[72178]: WARNING nova.compute.manager [req-363f402b-1279-4a7e-9ea7-921ee23fa826 req-5cb2145b-ac0f-4346-a986-dc09e4e8e773 service nova] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Received unexpected event network-vif-plugged-2f526db4-0d51-4030-9fc7-7c4f6dfdd014 for instance with vm_state deleted and task_state None.
Aug 01 12:28:38 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smSHBuYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:28:38 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:28:38 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:28:38 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7da23a7-b134-448b-ae20-8dfaadb8705f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:28:38 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bd7040-a97d-46f8-9c50-0593d9780bea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42] added
Aug 01 12:28:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[164a6a21-a83a-4e63-9244-a42bb5d75cf3]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[63283afd-a044-4f27-9470-40ef215ca3cf]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smSHBuYb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v smSHBuYb" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5a4119-b7f1-42f8-8211-5e55ca7f9647]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'smSHBuYb'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e79198-554c-43c5-b774-0f6b04cfc3e0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[249f91b6-f78f-4cda-9176-7a4c1790a910]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:28:38 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 01 12:28:38 user nova-compute[72178]:  {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:28:38 user nova-compute[72178]: WARNING os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 01 12:28:38 user nova-compute[72178]: 
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a488bce-f8b0-4c01-96b9-d5ede3aba268]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42, portal: 172.16.0.220,3260]
Aug 01 12:28:38 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42, portal: 172.16.0.220,3260] successful.
Aug 01 12:28:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4651f4-afb9-4109-b8fe-b85999368c67]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e143ae4-91d0-4a08-a3fa-e82445cfc7b3]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:28:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:28:38 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2931b4-356d-4954-8787-13dbfee5e1c8]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:28:38 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smSHBuYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26465313536343338', 'path': '/dev/sdb'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465313536343338', 'path': '/dev/sdb'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'flavor' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:28:39 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:28:39 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:28:39 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:28:39 user nova-compute[72178]:   <serial>ec2de807-b8ab-44d6-adca-bf9d630a3c42</serial>
Aug 01 12:28:39 user nova-compute[72178]: </disk>
Aug 01 12:28:39 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:28:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No VIF found with MAC fa:16:3e:0b:97:83, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:28:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9eb802d3-950f-47fe-ada4-c0a4114db3a1 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.357s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:42 user nova-compute[72178]: DEBUG nova.objects.instance [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'flavor' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:28:42 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:43 user nova-compute[72178]: INFO nova.compute.manager [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Attaching volume b93458b8-1f7c-4b47-97b6-24c0a2725315 to /dev/vdc
Aug 01 12:28:43 user nova-compute[72178]: DEBUG os_brick.utils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7164b0dc-bfa2-44c0-bd9d-98a9b2495c42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:bd56287b1627\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea804c57-e67a-4087-bed5-2113f6e52bef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2e2238-d438-4abe-beab-eb30155df942]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26bd51c-9cfa-4d5b-9782-d8f07adcf5df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Running cmd (subprocess): nvme version {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] 'nvme version' failed. Not Retrying. {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] nvme not present on system {{(pid=72178) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Aug 01 12:28:43 user nova-compute[72178]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 01 12:28:43 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d9c408-82ae-468c-81fc-dfa539d64ac7]: (4, '') {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72178) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.lightos [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] LIGHTOS: no hostnqn found. {{(pid=72178) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG os_brick.utils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:bd56287b1627', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG nova.virt.block_device [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating existing volume attachment record: fb7b3f84-367b-4b95-8060-5a84dc349758 {{(pid=72178) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 01 12:28:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:28:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:28:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:28:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:28:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:28:45 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:28:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating instance_info_cache with network_info: [{"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:28:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:28:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:28:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:51 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690892916.2040586, 06af0083-dfaa-4649-a993-52a6cc6fef0a => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:28:51 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] VM Stopped (Lifecycle Event)
Aug 01 12:28:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-471eef5c-7cfe-4f09-8ca4-5564290b1f07 None None] [instance: 06af0083-dfaa-4649-a993-52a6cc6fef0a] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:28:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:28:51 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:28:52 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Calling os-brick to attach iSCSI Volume {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCfayiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:28:54 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:28:54 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:28:54 user nova-compute[72178]: INFO os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b63dbd-51b8-4ea4-b531-1d59e23248ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 01 12:28:54 user nova-compute[72178]:  {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --interface default --op new {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c390606-494f-4c4f-bc56-1d33b939c9a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315] added\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315] added
Aug 01 12:28:54 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c42bd-d289-465b-89ca-0cb1149f7894]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3db4d01-c561-49d7-8b99-da5af81c98e7]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npCfayiV {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npCfayiV" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b2da36-ecd7-462c-90fe-e75e6270dee0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npCfayiV'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:54 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[6403f0cd-2697-4321-81c6-5b9e9e134bed]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd7391c-a27e-46b5-bf7a-c48cc5e0f3b9]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:28:55 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:28:55 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --login {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[db24b78f-0689-4682-8b66-bfa3a1283cbd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315, portal: 172.16.0.220,3260]
Aug 01 12:28:55 user nova-compute[72178]: Login to [iface: default, target: iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315, portal: 172.16.0.220,3260] successful.
Aug 01 12:28:55 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe23c04-f3f4-457e-8248-b46d79bf2c17]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[722cabeb-aab9-4c58-b8dd-f5e69df3653a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:28:55 user nova-compute[72178]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 (non-flash)
Aug 01 12:28:55 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:28:55 user nova-compute[72178]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 (non-flash)
Aug 01 12:28:55 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Connected to 172.16.0.220:3260 {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=72178) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72178) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[644e5516-ee66-4c64-8e13-92e0cd08fe69]: (4, ('- - 0', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72178) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCfayiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72178) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 01 12:28:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26137346265343066', 'path': '/dev/sdc'} {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137346265343066', 'path': '/dev/sdc'} {{(pid=72178) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.objects.instance [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'flavor' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] attach device xml: <disk type="block" device="disk">
Aug 01 12:28:56 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:28:56 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:28:56 user nova-compute[72178]:   <target dev="vdc" bus="virtio"/>
Aug 01 12:28:56 user nova-compute[72178]:   <serial>b93458b8-1f7c-4b47-97b6-24c0a2725315</serial>
Aug 01 12:28:56 user nova-compute[72178]: </disk>
Aug 01 12:28:56 user nova-compute[72178]:  {{(pid=72178) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] No VIF found with MAC fa:16:3e:0b:97:83, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-5a9cf1d3-9da4-4a59-a824-7390e75be09b tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.806s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:28:56 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=72178) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 01 12:28:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:28:57 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:28:57 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.22144317626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:28:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:28:58 user nova-compute[72178]: INFO nova.compute.manager [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Detaching volume b93458b8-1f7c-4b47-97b6-24c0a2725315
Aug 01 12:28:58 user nova-compute[72178]: INFO nova.virt.block_device [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Attempting to driver detach volume b93458b8-1f7c-4b47-97b6-24c0a2725315 from mountpoint /dev/vdc
Aug 01 12:28:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Attempting to detach device vdc from instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:28:58 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:28:58 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:28:58 user nova-compute[72178]:   <target dev="vdc" bus="virtio"/>
Aug 01 12:28:58 user nova-compute[72178]:   <serial>b93458b8-1f7c-4b47-97b6-24c0a2725315</serial>
Aug 01 12:28:58 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 12:28:58 user nova-compute[72178]: </disk>
Aug 01 12:28:58 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:28:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Successfully detached device vdc from instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 from the persistent domain config.
Aug 01 12:28:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:28:58 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:28:58 user nova-compute[72178]:   <source dev="/dev/sdc"/>
Aug 01 12:28:58 user nova-compute[72178]:   <target dev="vdc" bus="virtio"/>
Aug 01 12:28:58 user nova-compute[72178]:   <serial>b93458b8-1f7c-4b47-97b6-24c0a2725315</serial>
Aug 01 12:28:58 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 01 12:28:58 user nova-compute[72178]: </disk>
Aug 01 12:28:58 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892938.629931, f90d35dc-6b1b-4c80-a122-ae132c9b32a0 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:28:58 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Successfully detached device vdc from instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 from the live domain config.
Aug 01 12:28:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npCfayiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:28:58 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[45113f02-aba3-4f93-9fef-53d5b929d1a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[d064e9ed-970c-413c-864e-c112f484b206]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:28:58 user nova-compute[72178]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 (non-flash)
Aug 01 12:28:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:28:58 user nova-compute[72178]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 (non-flash)
Aug 01 12:28:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd9040d2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315'): ({'sdc'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Removing single pathed devices sdc {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda1510d-764a-4d18-a69a-4ba4b179612a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdabba8-183a-465a-b8cd-7cfc4486641b]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Flushing IO for device /dev/sdc {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4120ea8-c449-47f8-8ecb-5de1e2c7ed9b]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[30335783-6037-4150-ab02-6ac20a2306de]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] SCSI volumes sdc have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3629fe-cdc3-4272-9c61-7f1a0660b922]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e566b4c-1775-4045-a355-3155e51d22b1]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315, portal: 172.16.0.220,3260]
Aug 01 12:28:58 user nova-compute[72178]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315, portal: 172.16.0.220,3260] successful.
Aug 01 12:28:58 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b93458b8-1f7c-4b47-97b6-24c0a2725315 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[408633ef-714d-43c1-888b-3e45f3eac65d]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] <== disconnect_volume: return (259ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:28:58 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:28:59 user nova-compute[72178]: DEBUG nova.objects.instance [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'flavor' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:28:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-adbeed7f-0c90-4967-8e55-a9da1fe01c12 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.514s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:29:02 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:29:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:29:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:43 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:45 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:29:45 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:29:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:29:45 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:29:45 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:29:45 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:29:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating instance_info_cache with network_info: [{"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:29:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-f90d35dc-6b1b-4c80-a122-ae132c9b32a0" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:29:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:29:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:48 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:48 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:48 user nova-compute[72178]: INFO nova.compute.manager [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Detaching volume ec2de807-b8ab-44d6-adca-bf9d630a3c42
Aug 01 12:29:48 user nova-compute[72178]: INFO nova.virt.block_device [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Attempting to driver detach volume ec2de807-b8ab-44d6-adca-bf9d630a3c42 from mountpoint /dev/vdb
Aug 01 12:29:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Attempting to detach device vdb from instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 from the persistent domain config. {{(pid=72178) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 01 12:29:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:29:48 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:29:48 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:29:48 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:29:48 user nova-compute[72178]:   <serial>ec2de807-b8ab-44d6-adca-bf9d630a3c42</serial>
Aug 01 12:29:48 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:29:48 user nova-compute[72178]: </disk>
Aug 01 12:29:48 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:29:48 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Successfully detached device vdb from instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 from the persistent domain config.
Aug 01 12:29:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 from the live domain config. {{(pid=72178) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 01 12:29:48 user nova-compute[72178]: DEBUG nova.virt.libvirt.guest [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] detach device xml: <disk type="block" device="disk">
Aug 01 12:29:48 user nova-compute[72178]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 01 12:29:48 user nova-compute[72178]:   <source dev="/dev/sdb"/>
Aug 01 12:29:48 user nova-compute[72178]:   <target dev="vdb" bus="virtio"/>
Aug 01 12:29:48 user nova-compute[72178]:   <serial>ec2de807-b8ab-44d6-adca-bf9d630a3c42</serial>
Aug 01 12:29:48 user nova-compute[72178]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 01 12:29:48 user nova-compute[72178]: </disk>
Aug 01 12:29:48 user nova-compute[72178]:  {{(pid=72178) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Received event <DeviceRemovedEvent: 1690892989.2888696, f90d35dc-6b1b-4c80-a122-ae132c9b32a0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72178) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 01 12:29:49 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Successfully detached device vdb from instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 from the live domain config.
Aug 01 12:29:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] calling os-brick to detach iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd8f4234520>, {'target_iqns': ['iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'smSHBuYb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Aug 01 12:29:49 user nova-compute[72178]: WARNING os_brick.initiator.connectors.base [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42', 0)] {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14a26a-abdd-4e58-a1ef-03cf32bafe64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a212fda-e3b2-4dc8-9952-35ae6b70e11a]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:29:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 (non-flash)
Aug 01 12:29:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd8f46184c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42'): ({'sdb'}, set())}) {{(pid=72178) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Removing single pathed devices sdb {{(pid=72178) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[7019e1e5-eb25-41cb-976e-26c0b9319b0b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f89246-da0a-4f4a-b58b-13daf89cacd8]: (4, ('ok\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Flushing IO for device /dev/sdb {{(pid=72178) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[51957033-654e-4b04-a1eb-6ef30d7ac7b0]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72178) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e535bd-c745-4a5f-9900-3db07b2e9269]: (4, ('1', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.linuxscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] SCSI volumes sdb have been removed. {{(pid=72178) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42')] {{(pid=72178) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[b414a345-1532-479c-8faa-abb5e24fa769]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --logout {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad53156-e7e9-4ce8-8e84-78320bae6d97]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42, portal: 172.16.0.220,3260]
Aug 01 12:29:49 user nova-compute[72178]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42, portal: 172.16.0.220,3260] successful.
Aug 01 12:29:49 user nova-compute[72178]:  stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op delete {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec2de807-b8ab-44d6-adca-bf9d630a3c42 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83857) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da6accc-9b21-463b-abd3-f7e0816f23d8]: (4, ('', '')) {{(pid=83857) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72178) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.base [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG os_brick.initiator.connectors.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] <== disconnect_volume: return (285ms) None {{(pid=72178) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Aug 01 12:29:49 user nova-compute[72178]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Disconnected iSCSI Volume {{(pid=72178) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 01 12:29:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:50 user nova-compute[72178]: DEBUG nova.objects.instance [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'flavor' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:29:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-16cd6e7c-fbc9-4d87-a5a1-d73f2737a440 tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.642s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Starting instance... {{(pid=72178) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72178) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 01 12:29:51 user nova-compute[72178]: INFO nova.compute.claims [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Claim successful on node user
Aug 01 12:29:51 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Start building networks asynchronously for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Allocating IP information in the background. {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 01 12:29:51 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] allocate_for_instance() {{(pid=72178) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 01 12:29:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 01 12:29:51 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Start building block device mappings for instance. {{(pid=72178) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.policy [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b06620d3f824ad5879d2c5454727e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3243c75c13644fa89ab6d533b6e00ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72178) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Start spawning the instance on the hypervisor. {{(pid=72178) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Creating instance directory {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 01 12:29:52 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Creating image(s)
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "/opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "/opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "/opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.193s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk 1073741824 {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0,backing_fmt=raw /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk 1073741824" returned: 0 in 0.051s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "07353c5ae5938b5513d4c8f2f308bfca37a5bdf0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 --force-share --output=json" returned: 0 in 0.134s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk. size=1073741824 {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.virt.disk.api [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Cannot resize image /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk to a smaller size. {{(pid=72178) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lazy-loading 'migration_context' on Instance uuid 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Created local disks {{(pid=72178) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Ensure instance console log exists: /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/console.log {{(pid=72178) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:52 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Successfully created port: 9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Successfully updated port: 9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquired lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Building network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Instance cache missing network info. {{(pid=72178) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-3c325719-0975-4a0a-b3fc-f229d58ca1e1 req-306799f2-7d9d-4318-8225-ff74cab75a4d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received event network-changed-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.compute.manager [req-3c325719-0975-4a0a-b3fc-f229d58ca1e1 req-306799f2-7d9d-4318-8225-ff74cab75a4d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Refreshing instance network info cache due to event network-changed-9a1d4a29-538e-4194-b557-3cec49b46a21. {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3c325719-0975-4a0a-b3fc-f229d58ca1e1 req-306799f2-7d9d-4318-8225-ff74cab75a4d service nova] Acquiring lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.network.neutron [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Updating instance_info_cache with network_info: [{"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Releasing lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Instance network_info: |[{"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72178) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3c325719-0975-4a0a-b3fc-f229d58ca1e1 req-306799f2-7d9d-4318-8225-ff74cab75a4d service nova] Acquired lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.network.neutron [req-3c325719-0975-4a0a-b3fc-f229d58ca1e1 req-306799f2-7d9d-4318-8225-ff74cab75a4d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Refreshing network info cache for port 9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Start _get_guest_xml network_info=[{"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encrypted': False, 'size': 0, 'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'image_id': 'f38acd7b-c946-4724-9fc4-fe6cae069de4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 01 12:29:53 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:29:53 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] CPU controller missing on host. {{(pid=72178) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.host [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] CPU controller found on host. {{(pid=72178) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72178) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-01T11:54:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-01T11:54:50Z,direct_url=<?>,disk_format='qcow2',id=f38acd7b-c946-4724-9fc4-fe6cae069de4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='385d17d010204e7b81c7f663adf8b18a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-01T11:54:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Flavor limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Image limits 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Flavor pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Image pref 0:0:0 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72178) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Got 1 possible topologies {{(pid=72178) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 01 12:29:53 user nova-compute[72178]: DEBUG nova.virt.hardware [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72178) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-204158762',display_name='tempest-VolumesActionsTest-instance-204158762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-204158762',id=51,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3243c75c13644fa89ab6d533b6e00ee3',ramdisk_id='',reservation_id='r-wjxn6q7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-408317247',owner_user_name='tempest-VolumesActionsTest-408317247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:29:52Z,user_data=None,user_id='0b06620d3f824ad5879d2c5454727e4a',uuid=22e1bf31-a9a0-41dc-b1de-ebebcfd9c579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72178) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Converting VIF {"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:ed:5a,bridge_name='br-int',has_traffic_filtering=True,id=9a1d4a29-538e-4194-b557-3cec49b46a21,network=Network(17601ded-4bbb-4d64-8e31-cae27eb86cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d4a29-53') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.objects.instance [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lazy-loading 'pci_devices' on Instance uuid 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] End _get_guest_xml xml=<domain type="kvm">
Aug 01 12:29:54 user nova-compute[72178]:   <uuid>22e1bf31-a9a0-41dc-b1de-ebebcfd9c579</uuid>
Aug 01 12:29:54 user nova-compute[72178]:   <name>instance-00000033</name>
Aug 01 12:29:54 user nova-compute[72178]:   <memory>524288</memory>
Aug 01 12:29:54 user nova-compute[72178]:   <vcpu>1</vcpu>
Aug 01 12:29:54 user nova-compute[72178]:   <metadata>
Aug 01 12:29:54 user nova-compute[72178]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 01 12:29:54 user nova-compute[72178]:       <nova:package version="0.0.0"/>
Aug 01 12:29:54 user nova-compute[72178]:       <nova:name>tempest-VolumesActionsTest-instance-204158762</nova:name>
Aug 01 12:29:54 user nova-compute[72178]:       <nova:creationTime>2023-08-01 12:29:53</nova:creationTime>
Aug 01 12:29:54 user nova-compute[72178]:       <nova:flavor name="m1.tiny">
Aug 01 12:29:54 user nova-compute[72178]:         <nova:memory>512</nova:memory>
Aug 01 12:29:54 user nova-compute[72178]:         <nova:disk>1</nova:disk>
Aug 01 12:29:54 user nova-compute[72178]:         <nova:swap>0</nova:swap>
Aug 01 12:29:54 user nova-compute[72178]:         <nova:ephemeral>0</nova:ephemeral>
Aug 01 12:29:54 user nova-compute[72178]:         <nova:vcpus>1</nova:vcpus>
Aug 01 12:29:54 user nova-compute[72178]:       </nova:flavor>
Aug 01 12:29:54 user nova-compute[72178]:       <nova:owner>
Aug 01 12:29:54 user nova-compute[72178]:         <nova:user uuid="0b06620d3f824ad5879d2c5454727e4a">tempest-VolumesActionsTest-408317247-project-member</nova:user>
Aug 01 12:29:54 user nova-compute[72178]:         <nova:project uuid="3243c75c13644fa89ab6d533b6e00ee3">tempest-VolumesActionsTest-408317247</nova:project>
Aug 01 12:29:54 user nova-compute[72178]:       </nova:owner>
Aug 01 12:29:54 user nova-compute[72178]:       <nova:root type="image" uuid="f38acd7b-c946-4724-9fc4-fe6cae069de4"/>
Aug 01 12:29:54 user nova-compute[72178]:       <nova:ports>
Aug 01 12:29:54 user nova-compute[72178]:         <nova:port uuid="9a1d4a29-538e-4194-b557-3cec49b46a21">
Aug 01 12:29:54 user nova-compute[72178]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 01 12:29:54 user nova-compute[72178]:         </nova:port>
Aug 01 12:29:54 user nova-compute[72178]:       </nova:ports>
Aug 01 12:29:54 user nova-compute[72178]:     </nova:instance>
Aug 01 12:29:54 user nova-compute[72178]:   </metadata>
Aug 01 12:29:54 user nova-compute[72178]:   <sysinfo type="smbios">
Aug 01 12:29:54 user nova-compute[72178]:     <system>
Aug 01 12:29:54 user nova-compute[72178]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 01 12:29:54 user nova-compute[72178]:       <entry name="product">OpenStack Nova</entry>
Aug 01 12:29:54 user nova-compute[72178]:       <entry name="version">0.0.0</entry>
Aug 01 12:29:54 user nova-compute[72178]:       <entry name="serial">22e1bf31-a9a0-41dc-b1de-ebebcfd9c579</entry>
Aug 01 12:29:54 user nova-compute[72178]:       <entry name="uuid">22e1bf31-a9a0-41dc-b1de-ebebcfd9c579</entry>
Aug 01 12:29:54 user nova-compute[72178]:       <entry name="family">Virtual Machine</entry>
Aug 01 12:29:54 user nova-compute[72178]:     </system>
Aug 01 12:29:54 user nova-compute[72178]:   </sysinfo>
Aug 01 12:29:54 user nova-compute[72178]:   <os>
Aug 01 12:29:54 user nova-compute[72178]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 01 12:29:54 user nova-compute[72178]:     <boot dev="hd"/>
Aug 01 12:29:54 user nova-compute[72178]:     <smbios mode="sysinfo"/>
Aug 01 12:29:54 user nova-compute[72178]:   </os>
Aug 01 12:29:54 user nova-compute[72178]:   <features>
Aug 01 12:29:54 user nova-compute[72178]:     <acpi/>
Aug 01 12:29:54 user nova-compute[72178]:     <apic/>
Aug 01 12:29:54 user nova-compute[72178]:     <vmcoreinfo/>
Aug 01 12:29:54 user nova-compute[72178]:   </features>
Aug 01 12:29:54 user nova-compute[72178]:   <clock offset="utc">
Aug 01 12:29:54 user nova-compute[72178]:     <timer name="pit" tickpolicy="delay"/>
Aug 01 12:29:54 user nova-compute[72178]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 01 12:29:54 user nova-compute[72178]:     <timer name="hpet" present="no"/>
Aug 01 12:29:54 user nova-compute[72178]:   </clock>
Aug 01 12:29:54 user nova-compute[72178]:   <cpu mode="custom" match="exact">
Aug 01 12:29:54 user nova-compute[72178]:     <model>Nehalem</model>
Aug 01 12:29:54 user nova-compute[72178]:     <topology sockets="1" cores="1" threads="1"/>
Aug 01 12:29:54 user nova-compute[72178]:   </cpu>
Aug 01 12:29:54 user nova-compute[72178]:   <devices>
Aug 01 12:29:54 user nova-compute[72178]:     <disk type="file" device="disk">
Aug 01 12:29:54 user nova-compute[72178]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 01 12:29:54 user nova-compute[72178]:       <source file="/opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk"/>
Aug 01 12:29:54 user nova-compute[72178]:       <target dev="vda" bus="virtio"/>
Aug 01 12:29:54 user nova-compute[72178]:     </disk>
Aug 01 12:29:54 user nova-compute[72178]:     <interface type="ethernet">
Aug 01 12:29:54 user nova-compute[72178]:       <mac address="fa:16:3e:de:ed:5a"/>
Aug 01 12:29:54 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:29:54 user nova-compute[72178]:       <mtu size="1442"/>
Aug 01 12:29:54 user nova-compute[72178]:       <target dev="tap9a1d4a29-53"/>
Aug 01 12:29:54 user nova-compute[72178]:     </interface>
Aug 01 12:29:54 user nova-compute[72178]:     <serial type="pty">
Aug 01 12:29:54 user nova-compute[72178]:       <log file="/opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/console.log" append="off"/>
Aug 01 12:29:54 user nova-compute[72178]:     </serial>
Aug 01 12:29:54 user nova-compute[72178]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 01 12:29:54 user nova-compute[72178]:     <video>
Aug 01 12:29:54 user nova-compute[72178]:       <model type="virtio"/>
Aug 01 12:29:54 user nova-compute[72178]:     </video>
Aug 01 12:29:54 user nova-compute[72178]:     <rng model="virtio">
Aug 01 12:29:54 user nova-compute[72178]:       <backend model="random">/dev/urandom</backend>
Aug 01 12:29:54 user nova-compute[72178]:     </rng>
Aug 01 12:29:54 user nova-compute[72178]:     <controller type="usb" index="0" model="none"/>
Aug 01 12:29:54 user nova-compute[72178]:     <memballoon model="virtio">
Aug 01 12:29:54 user nova-compute[72178]:       <stats period="10"/>
Aug 01 12:29:54 user nova-compute[72178]:     </memballoon>
Aug 01 12:29:54 user nova-compute[72178]:   </devices>
Aug 01 12:29:54 user nova-compute[72178]: </domain>
Aug 01 12:29:54 user nova-compute[72178]:  {{(pid=72178) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-204158762',display_name='tempest-VolumesActionsTest-instance-204158762',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-204158762',id=51,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3243c75c13644fa89ab6d533b6e00ee3',ramdisk_id='',reservation_id='r-wjxn6q7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-408317247',owner_user_name='tempest-VolumesActionsTest-408317247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-01T12:29:52Z,user_data=None,user_id='0b06620d3f824ad5879d2c5454727e4a',uuid=22e1bf31-a9a0-41dc-b1de-ebebcfd9c579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Converting VIF {"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:ed:5a,bridge_name='br-int',has_traffic_filtering=True,id=9a1d4a29-538e-4194-b557-3cec49b46a21,network=Network(17601ded-4bbb-4d64-8e31-cae27eb86cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d4a29-53') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG os_vif [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:ed:5a,bridge_name='br-int',has_traffic_filtering=True,id=9a1d4a29-538e-4194-b557-3cec49b46a21,network=Network(17601ded-4bbb-4d64-8e31-cae27eb86cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d4a29-53') {{(pid=72178) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a1d4a29-53, may_exist=True, interface_attrs={}) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a1d4a29-53, col_values=(('external_ids', {'iface-id': '9a1d4a29-538e-4194-b557-3cec49b46a21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:ed:5a', 'vm-uuid': '22e1bf31-a9a0-41dc-b1de-ebebcfd9c579'}),), if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:54 user nova-compute[72178]: INFO os_vif [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:ed:5a,bridge_name='br-int',has_traffic_filtering=True,id=9a1d4a29-538e-4194-b557-3cec49b46a21,network=Network(17601ded-4bbb-4d64-8e31-cae27eb86cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d4a29-53')
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] No BDM found with device name vda, not building metadata. {{(pid=72178) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] No VIF found with MAC fa:16:3e:de:ed:5a, not building metadata {{(pid=72178) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-3c325719-0975-4a0a-b3fc-f229d58ca1e1 req-306799f2-7d9d-4318-8225-ff74cab75a4d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Updated VIF entry in instance network info cache for port 9a1d4a29-538e-4194-b557-3cec49b46a21. {{(pid=72178) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG nova.network.neutron [req-3c325719-0975-4a0a-b3fc-f229d58ca1e1 req-306799f2-7d9d-4318-8225-ff74cab75a4d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Updating instance_info_cache with network_info: [{"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:54 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-3c325719-0975-4a0a-b3fc-f229d58ca1e1 req-306799f2-7d9d-4318-8225-ff74cab75a4d service nova] Releasing lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-4c88b06b-4bcc-44c7-9d2d-e651e8354439 req-846080d0-3302-46b2-80fc-3bd5242d67d9 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received event network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4c88b06b-4bcc-44c7-9d2d-e651e8354439 req-846080d0-3302-46b2-80fc-3bd5242d67d9 service nova] Acquiring lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4c88b06b-4bcc-44c7-9d2d-e651e8354439 req-846080d0-3302-46b2-80fc-3bd5242d67d9 service nova] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-4c88b06b-4bcc-44c7-9d2d-e651e8354439 req-846080d0-3302-46b2-80fc-3bd5242d67d9 service nova] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG nova.compute.manager [req-4c88b06b-4bcc-44c7-9d2d-e651e8354439 req-846080d0-3302-46b2-80fc-3bd5242d67d9 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] No waiting events found dispatching network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:29:55 user nova-compute[72178]: WARNING nova.compute.manager [req-4c88b06b-4bcc-44c7-9d2d-e651e8354439 req-846080d0-3302-46b2-80fc-3bd5242d67d9 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received unexpected event network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 for instance with vm_state building and task_state spawning.
Aug 01 12:29:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892997.3807633, 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 => Resumed> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:29:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] VM Resumed (Lifecycle Event)
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Instance event wait completed in 0 seconds for  {{(pid=72178) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Guest created on hypervisor {{(pid=72178) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 01 12:29:57 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Instance spawned successfully.
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Found default for hw_cdrom_bus of ide {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Found default for hw_disk_bus of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Found default for hw_input_bus of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Found default for hw_pointer_model of None {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Found default for hw_video_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.libvirt.driver [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Found default for hw_vif_model of virtio {{(pid=72178) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:29:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.virt.driver [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] Emitting event <LifecycleEvent: 1690892997.3819826, 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 => Started> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:29:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] VM Started (Lifecycle Event)
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72178) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 01 12:29:57 user nova-compute[72178]: INFO nova.compute.manager [None req-10411acd-c08d-4fdf-9d02-863a261b2ae2 None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 01 12:29:57 user nova-compute[72178]: INFO nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Took 5.45 seconds to spawn the instance on the hypervisor.
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:29:57 user nova-compute[72178]: INFO nova.compute.manager [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Took 5.98 seconds to build instance.
Aug 01 12:29:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-b5754488-ac35-426e-a759-efbb1a388d8d tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.073s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-6f25e5b3-54a7-4be5-b44f-937330161731 req-788eba88-ee53-4da6-8fb8-fdfbbc51b223 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received event network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6f25e5b3-54a7-4be5-b44f-937330161731 req-788eba88-ee53-4da6-8fb8-fdfbbc51b223 service nova] Acquiring lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6f25e5b3-54a7-4be5-b44f-937330161731 req-788eba88-ee53-4da6-8fb8-fdfbbc51b223 service nova] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-6f25e5b3-54a7-4be5-b44f-937330161731 req-788eba88-ee53-4da6-8fb8-fdfbbc51b223 service nova] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:57 user nova-compute[72178]: DEBUG nova.compute.manager [req-6f25e5b3-54a7-4be5-b44f-937330161731 req-788eba88-ee53-4da6-8fb8-fdfbbc51b223 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] No waiting events found dispatching network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:29:57 user nova-compute[72178]: WARNING nova.compute.manager [req-6f25e5b3-54a7-4be5-b44f-937330161731 req-788eba88-ee53-4da6-8fb8-fdfbbc51b223 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received unexpected event network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 for instance with vm_state active and task_state None.
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:58 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:29:59 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:29:59 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:29:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8702MB free_disk=25.217838287353516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:29:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:30:02 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 01 12:30:02 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] There are 0 instances to clean {{(pid=72178) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 01 12:30:03 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:04 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:09 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:30:09 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:09 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Cleaning up deleted instances with incomplete migration  {{(pid=72178) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 01 12:30:11 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:13 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:14 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:18 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:19 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:23 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:28 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:29 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:30:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:30:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:30:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:30:34 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:30:39 user nova-compute[72178]: INFO nova.compute.manager [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Terminating instance
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.compute.manager [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-414bfa27-ea96-49c6-94fb-7b4929e7b257 req-4a40bbc3-d1fd-4e2f-8092-819de2106960 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received event network-vif-unplugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-414bfa27-ea96-49c6-94fb-7b4929e7b257 req-4a40bbc3-d1fd-4e2f-8092-819de2106960 service nova] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-414bfa27-ea96-49c6-94fb-7b4929e7b257 req-4a40bbc3-d1fd-4e2f-8092-819de2106960 service nova] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-414bfa27-ea96-49c6-94fb-7b4929e7b257 req-4a40bbc3-d1fd-4e2f-8092-819de2106960 service nova] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-414bfa27-ea96-49c6-94fb-7b4929e7b257 req-4a40bbc3-d1fd-4e2f-8092-819de2106960 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] No waiting events found dispatching network-vif-unplugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.compute.manager [req-414bfa27-ea96-49c6-94fb-7b4929e7b257 req-4a40bbc3-d1fd-4e2f-8092-819de2106960 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received event network-vif-unplugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Instance destroyed successfully.
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.objects.instance [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lazy-loading 'resources' on Instance uuid f90d35dc-6b1b-4c80-a122-ae132c9b32a0 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:26:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1938002166',display_name='tempest-TestServerVolumeAttachmentScenario-server-1938002166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1938002166',id=50,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX7GrlcHqLDlxZYTX4j7/8MJDQuhJWakB4hVrjzj4qBZDO9DZu9ZSi1WsbWczuBNRU62eOxUivBuLd0koqBFukMFmyI+lEE/T0TQ1yCkuMYsUldVIU402F1wWpS8F5TYg==',key_name='tempest-keypair-308692096',keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:26:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edeead892fa74272a53c42518d046895',ramdisk_id='',reservation_id='r-ongike9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-500706763',owner_user_name='tempest-TestServerVolumeAttachmentScenario-500706763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:26:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8046155edc9b47399c32a5500a3bbbe5',uuid=f90d35dc-6b1b-4c80-a122-ae132c9b32a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Converting VIF {"id": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "address": "fa:16:3e:0b:97:83", "network": {"id": "f5c7de12-5486-4aed-8441-e6aabd7e921d", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-158557059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edeead892fa74272a53c42518d046895", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c709738-7b", "ovs_interfaceid": "0c709738-7bf8-42aa-9c33-517ebbc08bdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:97:83,bridge_name='br-int',has_traffic_filtering=True,id=0c709738-7bf8-42aa-9c33-517ebbc08bdf,network=Network(f5c7de12-5486-4aed-8441-e6aabd7e921d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c709738-7b') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG os_vif [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:97:83,bridge_name='br-int',has_traffic_filtering=True,id=0c709738-7bf8-42aa-9c33-517ebbc08bdf,network=Network(f5c7de12-5486-4aed-8441-e6aabd7e921d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c709738-7b') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c709738-7b, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:30:39 user nova-compute[72178]: INFO os_vif [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:97:83,bridge_name='br-int',has_traffic_filtering=True,id=0c709738-7bf8-42aa-9c33-517ebbc08bdf,network=Network(f5c7de12-5486-4aed-8441-e6aabd7e921d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c709738-7b')
Aug 01 12:30:39 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Deleting instance files /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0_del
Aug 01 12:30:39 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Deletion of /opt/stack/data/nova/instances/f90d35dc-6b1b-4c80-a122-ae132c9b32a0_del complete
Aug 01 12:30:39 user nova-compute[72178]: INFO nova.compute.manager [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 01 12:30:39 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:30:39 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:30:40 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:30:40 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Took 0.73 seconds to deallocate network for instance.
Aug 01 12:30:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-3bd4fec9-94d0-45d1-a624-de735ad0d994 req-51e7a3dc-8f52-4dfd-86d2-ecd4b9bd5808 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received event network-vif-deleted-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:30:40 user nova-compute[72178]: INFO nova.compute.manager [req-3bd4fec9-94d0-45d1-a624-de735ad0d994 req-51e7a3dc-8f52-4dfd-86d2-ecd4b9bd5808 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Neutron deleted interface 0c709738-7bf8-42aa-9c33-517ebbc08bdf; detaching it from the instance and deleting it from the info cache
Aug 01 12:30:40 user nova-compute[72178]: DEBUG nova.network.neutron [req-3bd4fec9-94d0-45d1-a624-de735ad0d994 req-51e7a3dc-8f52-4dfd-86d2-ecd4b9bd5808 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:30:40 user nova-compute[72178]: DEBUG nova.compute.manager [req-3bd4fec9-94d0-45d1-a624-de735ad0d994 req-51e7a3dc-8f52-4dfd-86d2-ecd4b9bd5808 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Detach interface failed, port_id=0c709738-7bf8-42aa-9c33-517ebbc08bdf, reason: Instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0 could not be found. {{(pid=72178) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 01 12:30:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:30:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:30:40 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:30:40 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:30:40 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:30:41 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Deleted allocations for instance f90d35dc-6b1b-4c80-a122-ae132c9b32a0
Aug 01 12:30:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-fac6481f-eccc-481e-a0c1-fea2245750cb tempest-TestServerVolumeAttachmentScenario-500706763 tempest-TestServerVolumeAttachmentScenario-500706763-project-member] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:30:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-e058c697-1ad2-46ba-858e-5dd9c2d18bbe req-c860556e-bde0-4374-8dee-138349624bf3 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received event network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:30:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e058c697-1ad2-46ba-858e-5dd9c2d18bbe req-c860556e-bde0-4374-8dee-138349624bf3 service nova] Acquiring lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:30:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e058c697-1ad2-46ba-858e-5dd9c2d18bbe req-c860556e-bde0-4374-8dee-138349624bf3 service nova] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:30:41 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-e058c697-1ad2-46ba-858e-5dd9c2d18bbe req-c860556e-bde0-4374-8dee-138349624bf3 service nova] Lock "f90d35dc-6b1b-4c80-a122-ae132c9b32a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:30:41 user nova-compute[72178]: DEBUG nova.compute.manager [req-e058c697-1ad2-46ba-858e-5dd9c2d18bbe req-c860556e-bde0-4374-8dee-138349624bf3 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] No waiting events found dispatching network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:30:41 user nova-compute[72178]: WARNING nova.compute.manager [req-e058c697-1ad2-46ba-858e-5dd9c2d18bbe req-c860556e-bde0-4374-8dee-138349624bf3 service nova] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Received unexpected event network-vif-plugged-0c709738-7bf8-42aa-9c33-517ebbc08bdf for instance with vm_state deleted and task_state None.
Aug 01 12:30:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Updating instance_info_cache with network_info: [{"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:30:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:30:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:30:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:30:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:30:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:30:49 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:50 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:54 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690893039.8781178, f90d35dc-6b1b-4c80-a122-ae132c9b32a0 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:30:54 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] VM Stopped (Lifecycle Event)
Aug 01 12:30:54 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6fe3e8d2-416c-44aa-a252-39a11282d9b0 None None] [instance: f90d35dc-6b1b-4c80-a122-ae132c9b32a0] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:30:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:30:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:30:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:30:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:30:54 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:30:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:30:56 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:56 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:56 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:57 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 01 12:30:59 user nova-compute[72178]: DEBUG oslo_concurrency.processutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72178) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:00 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:31:00 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.21719741821289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Instance 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72178) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing inventories for resource provider f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Updating ProviderTree inventory for provider f106307e-ff81-42a0-bae9-51f40c919103 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Updating inventory in ProviderTree for provider f106307e-ff81-42a0-bae9-51f40c919103 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing aggregate associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, aggregates: None {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Refreshing trait associations for resource provider f106307e-ff81-42a0-bae9-51f40c919103, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSSE3,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_RAW {{(pid=72178) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:31:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:31:03 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:31:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:31:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:31:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:31:05 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:10 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:15 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:31:20 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:25 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:30 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:31:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:31:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:31:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:31:35 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:40 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:31:42 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:45 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:31:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:31:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Aug 01 12:31:46 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquired lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Aug 01 12:31:46 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Forcefully refreshing network info cache for instance {{(pid=72178) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 01 12:31:46 user nova-compute[72178]: DEBUG nova.objects.instance [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lazy-loading 'info_cache' on Instance uuid 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:31:47 user nova-compute[72178]: DEBUG nova.network.neutron [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Updating instance_info_cache with network_info: [{"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:31:47 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Releasing lock "refresh_cache-22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" {{(pid=72178) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Aug 01 12:31:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Updated the network info_cache for instance {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:31:50 user nova-compute[72178]: INFO nova.compute.manager [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Terminating instance
Aug 01 12:31:50 user nova-compute[72178]: DEBUG nova.compute.manager [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Start destroying the instance on the hypervisor. {{(pid=72178) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-7cc317b9-af2a-4753-a755-9ac036ecb503 req-c6d3f20b-9c45-4fc3-b229-940b73fe7327 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received event network-vif-unplugged-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cc317b9-af2a-4753-a755-9ac036ecb503 req-c6d3f20b-9c45-4fc3-b229-940b73fe7327 service nova] Acquiring lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cc317b9-af2a-4753-a755-9ac036ecb503 req-c6d3f20b-9c45-4fc3-b229-940b73fe7327 service nova] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-7cc317b9-af2a-4753-a755-9ac036ecb503 req-c6d3f20b-9c45-4fc3-b229-940b73fe7327 service nova] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-7cc317b9-af2a-4753-a755-9ac036ecb503 req-c6d3f20b-9c45-4fc3-b229-940b73fe7327 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] No waiting events found dispatching network-vif-unplugged-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:31:50 user nova-compute[72178]: DEBUG nova.compute.manager [req-7cc317b9-af2a-4753-a755-9ac036ecb503 req-c6d3f20b-9c45-4fc3-b229-940b73fe7327 service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received event network-vif-unplugged-9a1d4a29-538e-4194-b557-3cec49b46a21 for instance with task_state deleting. {{(pid=72178) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [-] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Instance destroyed successfully.
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.objects.instance [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lazy-loading 'resources' on Instance uuid 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 {{(pid=72178) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.virt.libvirt.vif [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-01T12:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-204158762',display_name='tempest-VolumesActionsTest-instance-204158762',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-204158762',id=51,image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-01T12:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3243c75c13644fa89ab6d533b6e00ee3',ramdisk_id='',reservation_id='r-wjxn6q7s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f38acd7b-c946-4724-9fc4-fe6cae069de4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-408317247',owner_user_name='tempest-VolumesActionsTest-408317247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-01T12:29:58Z,user_data=None,user_id='0b06620d3f824ad5879d2c5454727e4a',uuid=22e1bf31-a9a0-41dc-b1de-ebebcfd9c579,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Converting VIF {"id": "9a1d4a29-538e-4194-b557-3cec49b46a21", "address": "fa:16:3e:de:ed:5a", "network": {"id": "17601ded-4bbb-4d64-8e31-cae27eb86cf8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1919548187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3243c75c13644fa89ab6d533b6e00ee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a1d4a29-53", "ovs_interfaceid": "9a1d4a29-538e-4194-b557-3cec49b46a21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.network.os_vif_util [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:ed:5a,bridge_name='br-int',has_traffic_filtering=True,id=9a1d4a29-538e-4194-b557-3cec49b46a21,network=Network(17601ded-4bbb-4d64-8e31-cae27eb86cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d4a29-53') {{(pid=72178) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG os_vif [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:ed:5a,bridge_name='br-int',has_traffic_filtering=True,id=9a1d4a29-538e-4194-b557-3cec49b46a21,network=Network(17601ded-4bbb-4d64-8e31-cae27eb86cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d4a29-53') {{(pid=72178) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a1d4a29-53, bridge=br-int, if_exists=True) {{(pid=72178) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:31:51 user nova-compute[72178]: INFO os_vif [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:ed:5a,bridge_name='br-int',has_traffic_filtering=True,id=9a1d4a29-538e-4194-b557-3cec49b46a21,network=Network(17601ded-4bbb-4d64-8e31-cae27eb86cf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a1d4a29-53')
Aug 01 12:31:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Deleting instance files /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579_del
Aug 01 12:31:51 user nova-compute[72178]: INFO nova.virt.libvirt.driver [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Deletion of /opt/stack/data/nova/instances/22e1bf31-a9a0-41dc-b1de-ebebcfd9c579_del complete
Aug 01 12:31:51 user nova-compute[72178]: INFO nova.compute.manager [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 01 12:31:51 user nova-compute[72178]: DEBUG oslo.service.loopingcall [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72178) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.compute.manager [-] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Deallocating network for instance {{(pid=72178) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] deallocate_for_instance() {{(pid=72178) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.network.neutron [-] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Updating instance_info_cache with network_info: [] {{(pid=72178) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 01 12:31:51 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Took 0.49 seconds to deallocate network for instance.
Aug 01 12:31:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:31:51 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:31:51 user nova-compute[72178]: INFO nova.scheduler.client.report [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Deleted allocations for instance 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579
Aug 01 12:31:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-c585fd14-885d-4bd8-9678-117a84bfccc5 tempest-VolumesActionsTest-408317247 tempest-VolumesActionsTest-408317247-project-member] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.732s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:31:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-a6709e8e-98c9-4334-b135-3083e4ad6484 req-7bb054da-ce95-48c9-aed6-72a9c1f87a9d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received event network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:31:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a6709e8e-98c9-4334-b135-3083e4ad6484 req-7bb054da-ce95-48c9-aed6-72a9c1f87a9d service nova] Acquiring lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:31:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a6709e8e-98c9-4334-b135-3083e4ad6484 req-7bb054da-ce95-48c9-aed6-72a9c1f87a9d service nova] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:31:52 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [req-a6709e8e-98c9-4334-b135-3083e4ad6484 req-7bb054da-ce95-48c9-aed6-72a9c1f87a9d service nova] Lock "22e1bf31-a9a0-41dc-b1de-ebebcfd9c579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:31:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-a6709e8e-98c9-4334-b135-3083e4ad6484 req-7bb054da-ce95-48c9-aed6-72a9c1f87a9d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] No waiting events found dispatching network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 01 12:31:52 user nova-compute[72178]: WARNING nova.compute.manager [req-a6709e8e-98c9-4334-b135-3083e4ad6484 req-7bb054da-ce95-48c9-aed6-72a9c1f87a9d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received unexpected event network-vif-plugged-9a1d4a29-538e-4194-b557-3cec49b46a21 for instance with vm_state deleted and task_state None.
Aug 01 12:31:52 user nova-compute[72178]: DEBUG nova.compute.manager [req-a6709e8e-98c9-4334-b135-3083e4ad6484 req-7bb054da-ce95-48c9-aed6-72a9c1f87a9d service nova] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Received event network-vif-deleted-9a1d4a29-538e-4194-b557-3cec49b46a21 {{(pid=72178) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 01 12:31:55 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:55 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:31:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:31:57 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:57 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:57 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:58 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:58 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:31:59 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:31:59 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:31:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8896MB free_disk=25.23540496826172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:31:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:32:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:32:06 user nova-compute[72178]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690893111.1645288, 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579 => Stopped> {{(pid=72178) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 01 12:32:06 user nova-compute[72178]: INFO nova.compute.manager [-] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] VM Stopped (Lifecycle Event)
Aug 01 12:32:06 user nova-compute[72178]: DEBUG nova.compute.manager [None req-6012e995-3ee5-457e-98e5-a3f9bcd0eced None None] [instance: 22e1bf31-a9a0-41dc-b1de-ebebcfd9c579] Checking state {{(pid=72178) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 01 12:32:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:32:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:32:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:32:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:32:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:32:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:32:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:32:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:32:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:32:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:32:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72178) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Aug 01 12:32:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:32:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72178) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Aug 01 12:32:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:32:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:32:46 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:32:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:32:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:32:46 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 12:32:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:32:53 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:32:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:32:56 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:32:56 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:32:57 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:32:58 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:32:58 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:32:59 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:32:59 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:32:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.234050750732422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:32:59 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.112s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:33:00 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:33:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:33:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:33:07 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:33:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:33:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:33:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:24 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:26 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:27 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:31 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:36 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:33:41 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:44 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:46 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:47 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:33:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Starting heal instance info cache {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 01 12:33:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Rebuilding the list of instances to heal {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 01 12:33:47 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Didn't find any instances for network info cache update. {{(pid=72178) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 01 12:33:48 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:50 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:51 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:52 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:53 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:54 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:33:55 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:56 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:58 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:33:58 user nova-compute[72178]: DEBUG nova.compute.manager [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72178) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 01 12:33:58 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:33:59 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:33:59 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:33:59 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager.update_available_resource {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Auditing locally available compute resources for user (node: user) {{(pid=72178) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 01 12:34:00 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:34:00 user nova-compute[72178]: WARNING nova.virt.libvirt.driver [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 01 12:34:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=25.230716705322266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72178) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 01 12:34:00 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72178) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 01 12:34:01 user nova-compute[72178]: DEBUG nova.compute.provider_tree [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed in ProviderTree for provider: f106307e-ff81-42a0-bae9-51f40c919103 {{(pid=72178) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 01 12:34:01 user nova-compute[72178]: DEBUG nova.scheduler.client.report [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Inventory has not changed for provider f106307e-ff81-42a0-bae9-51f40c919103 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72178) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 01 12:34:01 user nova-compute[72178]: DEBUG nova.compute.resource_tracker [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Compute_service record updated for user:user {{(pid=72178) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 01 12:34:01 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:34:01 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:34:06 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:34:11 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:34:16 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72178) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG oslo_service.periodic_task [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72178) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG oslo_concurrency.lockutils [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72178) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Verify base images {{(pid=72178) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0
Aug 01 12:34:21 user nova-compute[72178]: WARNING nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Unknown base file: /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Removable base files: /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983 /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7 /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0 /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0 /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/12578fc8e1dd1d83275da3cc3a8e49432b90690a
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fd9d0c53e8a4121de9258c4243b929264f436f5e
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bebb5a3cdf9d388332eb61ce55a00547c1f0b983
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9d432c4b576e83093fb5f73ed4476c688d4bd30f
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b34ccdb69a7b7f9d206e4573a83f4512bdc4d5d7
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/07353c5ae5938b5513d4c8f2f308bfca37a5bdf0
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d8d590ea56dd6150010efc4cbac746d986f21c1d
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b412d9bd6eab3f72dc1d1546a1caf1b7b3ee37ff
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b019111ba1a850dd24c26ed34c604f2b6b09a4f0
Aug 01 12:34:21 user nova-compute[72178]: INFO nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9b14ee739bc6d42a712e62f5a22d53b8e9be56b8
Aug 01 12:34:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Verification complete {{(pid=72178) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Verify swap images {{(pid=72178) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 01 12:34:21 user nova-compute[72178]: DEBUG nova.virt.libvirt.imagecache [None req-9648fac8-6d26-42d5-896e-79c1ccd8e4ae None None] Verify ephemeral images {{(pid=72178) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}